I am working on a vocabulary-building book for SAT and GRE students. Below is a picture of the provisional cover of the book:
In order to have a wide corpus of classical texts to find word usage examples, I downloaded a massive ebook collection from the Gutenberg project and merged all of the text files into one big file that reached 12.4 gigabytes in size. I then wrote a PHP script that used the grep utility to search through about 250 billion lines of text1 to find the word usages I needed.
Here is an example of the results for the word “taciturn”:
In order to find interesting examples, I use the following regular expression:
egrep -aRh -B 20 -A 20 "\b(she|her|hers|his|he)\b.*taciturn" merged.txt
This finds usages of the word that start with a pronoun such as “she”. This helps find usages that occur mostly in novels, rather than other types of books (the Gutenberg collection contains many non-novel files, such as encyclopedias and legal works).
My first step toward speeding up the grep was to move the file to an old SSD I have that is attached to my desktop. The SSD supports up to 200 MB/second read speeds. This was not good enough, so I eventually moved it to my main Samsung SSD which has over 500 MB/second read speeds. Below is a screenshot of the iotop utility reporting a read speed of 447 M/s while grep is running:
My first idea to speed up the grep was to use GNU parallel or xargs, both of which allow grep to make use of multiple CPU cores. This was misguided since the limiting factor in this grep was not CPU usage but disk usage. Since my SSD is being maxed out, there is no point in adding more CPU cores to the task.
Using the following grep command, it took a little over 30 seconds to finish grepping the entire file once:
Here is the output for the time command which tells how long a command takes to finish:
One of the first suggestions I found is to prefix the command with LC_ALL=C, this tells grep to avoid searching through non-ANSI-C characters.
That seemed to make the grep very slightly faster:
Just to see what happens, I next used the fmt utility to reformat the file. The file currently is made up of short lines all separated by new lines. Using fmt, I changed it to having lines of 500 characters each. This was likely going to make the grep slower since it was going to match a lot more lines since the lines were going to be longer:
But on the upside, I was going to get a lot more results. The fmt command decreased the number of lines from 246 million to only 37 million:
But actually what happened when I did the next grep was that the grep time decreased to only 23 seconds:
I guess the reason is that grep has a lot fewer lines to go through.
Unfortunately it looked like fmt had corrupted the text. Here is an example:
I think the reason was that some (or most, or all) of the text files were using Windows-style newlines rather than Unix-style ones which was perhaps confusing fmt. So I used this command to convert all Windows-style newlines into spaces:
After that operation and running fmt again on the result, grepping again seems to result in non-corrupt results:
And:
I also looked for the corrupted passage above to see how it looked now:
So it all seems fine now.
As far as I know there is no way to speed up the grep significantly further unless I get a lot of RAM and do the grep on a ramdisk, or get a much faster SSD. Just out of curiosity I decided to try out changing the fmt command to make lines of 1500 characters each to see how that affects the grep:
That didn’t actually do anything to speed up the grep further:
AssalamAleikumWarahmatullah How does one have faith in yourself after disappointing yourself many times? I pray during day, listening to music at night. I study Quran 3 days a row, I don’t study for 3 weeks. I keep going forth and back. I lose hope in myself and am very disappointed in myself..
Alaikumassalam wa rahmatullah,
You do not actually need to have any faith in yourself. Long ago I lost all faith in myself, realized that I could not do any good deeds or anything that benefits me except by God’s will and permission, and so I realized that all of my faith should be in God alone.
Rather than seeking to be good through your own efforts, seek it through God. Ask God to make it easy for you to be good and consistent in your good deeds. Ask Him every day and rely on Him and acknowledge your own powerlessness. Even if you fail a thousand times, keep going back to Him.
Face God with your heart day and night and stop looking at yourself. All good comes through Him. And whenever you are disappointed in yourself, use this as an opportunity to pray to God for guidance and the ability to be better.
So hold tightly to God through everything that happens to you and keep going back to Him and asking Him for help and guidance. The first step is to stop relying on yourself and to rely on God. Once you do that, His help can come to you and make you better than you could imagine.
What does your average working day look like? And how did you became interested in Islamic topics?
My first task in the morning is to read and answer the questions I have received through my site, email or on tumblr.
After that I work on any programming project that my clients have sent me. If there are no projects, I work on my own projects, mainly books I write.
Sometimes I have an idea for an essay or blog post, so I may stop working on my projects to write the essay or post.
If I have no projects to work on I read books. I have thousands of books on my reading list, so I am never short of books that I want to read.
I work until around 4 PM. After that I listen to Quran for an hour, maybe exercise, then spend time with my children.
I have always had a special relationship with Islam, maybe because of growing up in a devout and educated Muslim family and having a few Islamic scholars among my relatives. So it simply seemed natural to me to study Islam. But I started studying Islam in a serious and scholarly manner only at the end of 2017. That is when I decided to dedicate my life to Islamic studies and started reading scholarly books, both classical Arabic books and books published by Western (Muslim and non-Muslim) scholars of Islam. I also started reading scholarly papers in Islamic studies published in Western academic journals.
I feel like I failed God's test that was sent to me, miserably. What do I do?
Ask for forgiveness and realize that you will be tested again and again every day of your life. If you fail one test, you still have the opportunity to pass thousands of tests in the future.
Never let your failures dishearten you. Always go back to God and seek His help and guidance. He is ready to forgive and give you another chance even if you fail countless times. God’s mercy and forgiveness are greater than your failures and sins.
After performing istikhara, can what is about to happen in the future come in the form of dreams?
While that is always possible, there is no guarantee that the dream is related to the istakhara since we do not have anything in the Quran or hadith that says so.
Assalamualaikum, I would like to ask you how do we be humble and sincere in our deeds in life. I am asking this because I am struggling to apply these two virtues in my life. It also caused me to be depressed when I am doing something to achieve pride,arrogance and peer recognition.
Alaikumassalam wa rahmatullah,
The two best cures I know for avoiding arrogance and pride are these: the first one is to read or listen to the Quran daily (I recommend an hour a day). The Quran is a great cure for all of the problems of one’s character. But it is necessary to do it daily because otherwise the good influence would fade. It is simply impossible to achieve a high character and stay in that state without working for it every day.
The second cure is to read the spiritual sayings of the great Islamic scholars. I have gathered those sayings in my book The Way of the Spiritual Muslim and I have found them extremely beneficial and humbling. If you submit your email address, I can send you a free ebook copy of it.
Swa Is it haram to have lash extension, and if it’s okay to do it as a job.
Alaikumassalam wa rahmatullah,
As discussed in this previous answer, some scholars consider lash extensions permissible, while others consider them prohibited.
Doing it as a job would be permitted according to the scholars who consider lash extensions permissible, while those who consider them prohibited would not permit it.
Both opinions have their own validity, so I cannot really say which one is to be preferred.
Non-muakkada sunna deeds are still recommended, but you do not have to do them. They are not obligatory and they are not strongly recommended. But they are still good deeds and you can choose to do them.
Preamble: What is the point of this calculation method when we already have well-established methods of hadith verification?
The point is simple: you may want to compare one authentic hadith’s reliability with another authentic hadith’s reliability (perhaps they seem to contradict each other). And they both have 5-10 complex chains of transmitters each of which involves a hundred transmitters. How do you know which one is the stronger?
In such cases we can have a case of intellectual overload that makes it very difficult to make an accurate judgment. The totality of the chains of both hadiths may seem similar in strength (just because of the overwhelming amount of chains and branches and transmitters), but if you had an exact way to calculate each chain’s strength and combine them with each other, you will gain empirical knowledge of the strengths of the chains instead of having to go by a hunch.
Imagine a hadith that goes through three transmitters: The Prophet PBUH > A > B > C. This hadith has a certain strength. Now imagine another hadith that goes through four transmitters, The Prophet PBUH > D > E > F > G. Any hadith scholar would tell you that the first hadith has a better chain, assuming the transmitters are all of comparable quality, because it is shorter, relies on fewer people.
The probability calculation simply brings out this hadith scholar’s knowledge and converts it to a number. We are not bringing anything new to the verification of hadith, we are simply converting the information already included in the chains and the books of transmitter criticism into an easily usable number. The three transmitter hadith has a strength of 21.6% while the four transmitter hadith has a strength of 12.96%.
These are very low numbers, and for a good reason: we only provided one chain for each hadith, which makes them shādhdh hadiths that no one else apart from the last transmitter in each chain transmitted. This type of situation is very suspicious. But for the vast majority of hadiths, we will have numerous chains, and each chain’s strength adds on to the others’ until we get the total number.
There is only one assumption that goes into the calculation. We are assuming each reliable narrator’s information has 60% integrity. This number is based on the generally known fact that information degrades as it passes from one person to another over historical time. This number is not a judgment on the transmitter, but on the transmission. And the purpose of it is that it enables us to combine multiple lines of transmission in a mathematically valid way while accounting for information degradation. We must choose some integrity value, and if we give each trustworthy transmitter an integrity value of 100%, that gives the hadith a 100% chance of authenticity, which makes it impossible to compare one authentic hadith with another hadith. We must have a way to simulate the degradation of information over time, the fact that, for example, a statement of the Prophet PBUH passed down over 200 years by numerous generations isn’t as likely to be accurate as a statement written down by Imam Mālik, who heard it from Nāfiʿ, who heard it from the Companion Ibn ʿUmar.
By giving each piece of information this 60% probability, we are saying we give it the benefit of the doubt, that it is more likely to be true than false. Other researchers can play with using a different number, this doesn’t affect the method too much as long as the number is not ridiculous high or low, because our purpose is to compare authentic hadiths together, and if your lower probability value lowers the probability of one hadith, it will do the same for the other hadith, and the ability to compare them still remains. Personally, after having tried various probabilities, this 60% value has seemed the most fitting, because it means information given by four witnesses has a 97.44% chance of authenticity, and the “gold standard” of mutawātir mentioned by some fiqh scholars is eight witnesses, which with this method gives us a 99.93% chance of authenticity, showing that the intuition of the fiqh scholars is correct; such a probability of authenticity is beyond any reasonable doubt.
To put it simply: If one person narrates a very important and controversial story to you about some event (and all hadiths are like this in their sensitivity, since they affect our faith), you give the story a probability of 60% of being true and accurate, despite the fact that you trust the person. You wish to have more corroboration before you fully accept the story (similar to Umar b. al-Khaṭṭāb asked for a second Companion’s witness when a Companion narrated something from the Prophet PBUH). Now if another equally trustworthy person narrates the same story to you with the same details, the chance of the veracity of the story goes up. You now have two independent pieces of evidence, each of which has a 60% chance of being authentic.
In probability theory we can combine these two probabilities. We multiply the chances of each piece of evidence not being true, that is, 40% * 40%. When doing probability math, we use 1 to mean 100%, and 0.4 to represent 40%. So here we have 0.4*0.4, which equals 0.16. In other words, while each piece of information by itself is 40% likely to be false, the two pieces of information together are 16% likely to be false. It is a case of having one witness versus having two witnesses for a certain event. Each additional witness decreases the chance of falsehood.
Now that we have the new chance of falsehood (16%, or 0.16 for our math), we can calculate the chance of the truth and accuracy of the information. You can probably do it in your head. If something is 16% likely to be false, it is 84% likely to be true.
(See below for a more detailed description of the way calculations are done, with illustrations.)
And that is the entirety of the method. We combine the chance of veracity of information transmitted by each transmitter. Information going down the chain degrades, while information being carried by multiple witnesses better maintains its integrity.
This kind of calculation is not very useful when dealing with a hadith that has only a chain or two. Its value becomes clear when you have to find out the strength of a hadith (within the context of other hadiths or the general sahih hadith corpus) with large branching chains involving dozens of transmitters.
Introduction
The study of hadith has been by and large restricted to hadith scholars. In this essay I present a fundamentally new approach to the study of hadith that combines the disciplines of traditional hadith criticism with uṣul al-fiqh (legal theory). For over a millennium, scholars of legal theory have discussed what makes certain hadiths mutawātir, or true beyond doubt, but these discussions have unfortunately been almost entirely ignored by hadith scholars. By combining legal theory with hadith criticism, we gain a powerful new empirical tool for judging the authenticity of hadiths that enables fiqh scholars to tap the vast resources of the science of hadith while implementing the long-neglected field of legal theory in the way hadiths are handled.
Counting the number of chains that a hadith possesses has been a traditional method of determining the strength of one hadith compared to another. Another method has been to determine the length of a chain. Hadiths with shorter chains were highly prized due to their higher authenticity. This method integrates both of these concepts: Hadiths with more chains and shorter chains receive higher percentage rankings than hadiths with fewer chains or shorter chains.
From binary to analog
It is rarely mentioned in scholarly circles and among the rest of the Muslim community that the categories that hadiths are placed into by hadith scholars, such as ṣaḥīḥ, are artificial, made-up categories. Some ṣaḥīḥ hadiths are vastly superior in their authenticity compared to other ṣaḥīḥ hadiths, and hadith scholars are well aware of this.
It was natural and convenient for hadith scholars of the early and classical periods to view hadiths as being either ṣaḥīḥ or not-ṣaḥīḥ (ḥasan, ḍaʿīf, etc.). This is what I call binary thinking. It divides the world of hadith into two parts, one of which, ṣaḥīḥ, is assumed to be practically perfectly reliable despite the awareness that no two ṣaḥīḥ hadiths are ever equally reliable. It’s similar to dividing one’s friends and acquaintances into two categories, “trustworthy” and “untrustworthy”, despite the fact that we know the real world is much more complicated than that and that people, in reality, are on a spectrum of trustworthiness from most trustworthy to least trustworthy.
The essential innovation that my verification method introduces is that it supersedes the artificial, binary thinking of traditional hadith science by introducing an analog method of categorizing hadiths, suggested to me not by hadith scholars but by scholars of legal theory in their discussions of the reliability of hadiths, that better represents reality. In the traditional method a hadith can either be ṣaḥīḥ or not-ṣaḥīḥ, while in my method a hadith can be 20% likely to be authentic, or 30%, or 90%. The method has room for representing all the various shades of authenticity that are hidden to ordinary Muslims when they read that a particular hadith is authentic.
This method helps free the great treasures of the science of hadith criticism that have so far been locked away in hadith collections and the works of hadith transmitter criticism (ʿilm al-rijāl) so that every Muslim can benefit from them by having that knowledge translated into an easy-to-understand mathematical ranking system.
Hadith and probability theory
Islam’s hadith literature (reports about the actions and sayings of the Prophet PBUH) is one of the most problematic aspects of the religion due to the issues concerning the reliability of transmitters. How do we know if a report going back six or seven generations to the Prophet PBUH truly and accurately reports what the Prophet PBUH said or did?
So far the science of hadith has largely limited itself to verifying the authenticity of hadiths by verifying the trustworthiness of each person in a hadith’s chain of narrators. If all the transmitters are trustworthy, the assumption is that the hadith is ṣaḥīḥ (“authentic” or “sound”) unless the hadith reports things that are clearly false or contradictory to other hadith narrations. The problem is that a hadith scholar’s own beliefs and biases can strongly affect whether they consider a strange and rare hadith to be authentic or not. A good example is the following hadith in Imām al-Bukhārīʾs collection:
Narrated Abu 'Amir or Abu Malik Al-Ash'ari that he heard the Prophet (ﷺ) saying, "From among my followers there will be some people who will consider illegal sexual intercourse, khazz (a type of clothing), the wearing of silk, the drinking of alcoholic drinks and the use of musical instruments, as lawful. And there will be some people who will stay near the side of a mountain and in the evening their shepherd will come to them with their sheep and ask them for something, but they will say to him, 'Return to us tomorrow.' Allah will destroy them during the night and will let the mountain fall on them, and He will transform the rest of them into monkeys and pigs and they will remain so till the Day of Resurrection."
(Ṣaḥīḥ al-Bukhārī 5590)
A non-scholar who reads this hadith will be greatly troubled by the implication that the use of musical instruments is a characteristic of misguided and impious Muslims. And since the hadith is authentic and present in Ṣaḥīḥ al-Bukhārī, they will face the difficult choice of either believing musical instruments (and hence all music) to be forbidden in Islam, or ignoring the hadith and going with the commonsense and widespread Muslim belief that music is permissible in Islam.
By introducing probability theory into the science of hadith, we gain an extremely powerful tool that enables us to judge just how seriously we should take any particular hadith. This is especially useful in the case of hadiths that seem to be contradicted by other hadiths. For example on the issue of musical instruments we have the following hadith:
Narrated Aisha:
Abu Bakr came to my house while two small Ansari girls were singing beside me the stories of the Ansar concerning the Day of Buath. And they were not singers. Abu Bakr said protestingly, "Musical instruments of Satan in the house of Allah's Messenger (ﷺ) !" It happened on the `Id day and Allah's Messenger (ﷺ) said, "O Abu Bakr! There is an `Id for every nation and this is our `Id."
Sahih al-Bukhari 952
An authentic version of this hadith (Sahih Muslim 892 b) tells us that the girls were using the instrument daff (“tambourine”). So here we have the Prophet PBUH approving of the use of musical instruments in his own home, yet the other hadith implies that musical instruments are wicked and unlawful.
Probabilistic hadith criticism helps solve the dilemma of having to choose between two hadiths that are both judged authentic by hadith scholars by telling us which one is stronger.
As it happens, the hadith mentioning the Prophet’s approval of musical instruments is far more “authentic” and believable than the hadith in which he disapproves of them.
In this essay I will use these hadiths on music as an illustration of the probabilistic hadith verification method.
Gathering the hadiths approving of music
The first step in hadith verification is to gather all existing versions of a hadith and their chains and to draw a diagram representing all of its transmitters. Below is a diagram of the version of the “two singing girls” hadiths found in Sahih al-Bukhari:
The blue box is the hadith, and the gray boxes are its transmitters. The first transmitter is Aisha, may God be pleased with her, wife of the Prophet PBUH. The second transmitter is Urwa b. al-Zubayr, her nephew. The third transmitter is Urwa’s son Hisham. The the fourth transmitter is the highly respected hadith scholar Hammad b. Usama b. Zayd. The fifth transmitter is Ubayd b. Ismail, a respected hadith transmitter. This transmitter gave the hadith to Imam al-Bukhari who recorded it.
The second version of the hadith is also in Sahih al-Bukhari:
Narrated Aisha:
That once Abu Bakr came to her on the day of `Id-ul-Fitr or `Id ul Adha while the Prophet (ﷺ) was with her and there were two girl singers with her, singing songs of the Ansar about the day of Buath. Abu Bakr said twice. "Musical instrument of Satan!" But the Prophet (ﷺ) said, "Leave them Abu Bakr, for every nation has an `Id (i.e. festival) and this day is our `Id."
Sahih al-Bukhari 3931
Below is a diagram of this hadith’s chain:
You may note that the first three transmitters are the same as those of the previous hadith. So we can join their diagrams into one as follows:
Next is the chain found in Sahih Muslim 892 a:
This chain is exactly the same as the al-Bukhari’s first chain except for the last transmitter. We can therefore join it with the rest as follows:
We now therefore have three chains going back to the same hadith. Imam Muslim mentions two additional chains which we add to the diagram as follows:
We now move on to other collections that mention the same hadith. The first one is a version mentioned in Abu Uwaana’s Mustakhraj, which we add to the diagram as follows:
I have indicated the new chain in green. After further research, I was able to discover a further chain in Sahih al-Bukhari as indicated below:
Al-Bukhari mentions an alternative version of this new chain as indicated below:
The scholar Abu Uwana adds two of his own supporting chains to this version as follows:
We now have a fairly complete picture of all of the different chains of this hadith.
Adding the probabilities
To understand this section, some previous knowledge of probability theory will likely be required.
In order to start, we have to agree on an important assumption. How trustworthy is a single transmitter? This is a matter of intuition. After trying out various probabilities, I have settled on the value of 60%. This means that each trustworthy transmitter in a chain has a 60% chance of truthfully and correctly transmitting the hadith they transmit. This may seem low, but it actually works very well to represent the issues inherent in hadith transmitter verification.
This 60% is not a judgment on the transmitter’s character. It is a judgment on this specific piece of information in this specific place in the chain. It does not mean that a transmitter is 60% likely to be trustworthy. Rather, it is based on the uṣūl al-fiqh (Islamic legal theory) discussions on the number of witnesses needed for a certain piece of information to be considered mutawātir or true beyond doubt (see Wael B. Hallaq in Islamic Law and Jurisprudence: Studies in Honor of Farhat J. Ziadeh). It is general knowledge among scholars of legal theory that a single witness, no matter how trustworthy, can never impart certain knowledge. This is why Islamic law requires multiple witnesses in various legal cases. This requirement for multiple witnesses is not a judgment on the character of individual witnesses. It is a guarantee against various forms of error and uncertainty. According to the 60% assumption, four trustworthy witnesses mentioning the same piece of information side-by-side have a 97.44% chance of imparting it truthfully and correctly, while eight witnesses have a 99.93% chance, making a piece of information practically mutawātir, or widely-transmitted.
The 60% assumption takes into account the concept of signal decay. While a trustworthy witness who heard a piece of information today may have a 100% chance of imparting it correctly today, hadiths are transmitted between witnesses who may have held onto the information for decades. A hadith with four transmitters in its chain may in fact represent information passed down over four generations. There is an inherent signal decay in this multi-generational process, and the 60% assumption helps simulate this decay by requiring multiple transmitters at each point of the chain to maintain signal integrity.
According to probability theory, if you have a witness with 60% probability of truthfulness saying something, and then a second witness also with 60% probability of truthfulness comes along and says the same thing, the probability of both of them saying the truth increases, since we have two witnesses saying the same thing. We calculate this increase by multiplying the falsehood probabilities of the two persons as follows:
Person 1: 60% chance of truth = 40% chance of falsehood
Person 2: 60% chance of truth = 40% chance of falsehood
The chance of falsehood for both = 40% * 40% = 16%
The chance of truth of both = 100% - the chance of falsehood = 100% - 16% = 84%
Below is a diagram of an imaginary chain that represents these facts:
We have two people each of whom say that the Prophet PBUH said something. Each of them has a 60% probability of truthfulness and accuracy, but the two of them together have a 84% probability of truthfulness and accuracy, so the above imaginary hadith has an 84% chance of truthfulness and accuracy.
As we add more transmitters, the probability continually goes up:
Now we have four supporting witnesses, so their probability of truthfulness can be calculated as follows:
What this means is that if you have four Companions transmit the same hadith from the Prophet PBUH, the chance of the hadith being truly and correctly transmitted is 97.44%, which is a very high chance.
In probability theory 1 represents 100% and 0 represents 0. So another way of doing the above calculation is as follows:
0.4 * 0.4 * 0.4 * 0.4 = 0.0256
1 - 0.0256 = 0.9744
The benefits of the 60% assumption will become clear as we go through the verification process of the chains we gathered earlier. We will first deal with the top part of the diagram, which is as follows:
First, we will fill in the original 60% assumption by writing 0.6 in each bubble:
We do not add the 0.6 to the bubbles on the far right because those are written books, so they virtually have a 100% chance of reliability. What concerns us are unwritten, oral transmissions. The first step is to combine the three middle transmitters’ probabilities vertically, as follows:
Above, each of the three transmitters has a 100% – 60%, or 40% likelihood of falsely transmitting the hadith. But in order to get the probability of all of them falsely transmitting the hadith at the same time, we have to multiply these chances together: 40% * 40% * 40% = 6.4%. So the chance of all of them having falsely transmitted the hadith is only 6.4%, meaning that there is a 93.6% chance of them having truly and accurately transmitted this hadith.
We will call this “vertical combination”. We vertically combine all of the probabilities of the truthfulness and accuracy of the transmitters to get a single number, in this case 93.6%, which represents the authenticity of all them combined together.
We next have to do a horizontal combination. All three transmitters transmit the hadith from Hammad b. Usama, who also has a 0.6 (60%) chance of authenticity.
In the case of horizontal combination, rather than multiplying falsehood probabilities, we multiply truth probabilities. The reason is that as information passes down through a chain of transmitters each of whom have a 60% chance of authenticity, the chance of the information being correctly passed down decreases. There is more chance for error and fabrication. If you hear a Companion say that the Prophet PBUH said something, that is far more trustworthy than another person saying they heard their father say that their grandfather said that a Companion said that the Prophet PBUH said that.
So we multiply 0.93 by 0.6 to get 0.558, which means 55.8%. We now update the bubble for Hammad b. Usama to represent this new probability:
Hammad b. Usama’s probability went down from 0.6 to 0.558 because we did not hear the hadith directly from him, but from three people who claim to have heard him. Since those three people have a combined probability of 93% truthfulness and accuracy (rather than 100%), this slightly decreases the probability of the truthfulness and accuracy of the information we get from Hammad b. Usama.
We now move on to al-Bukhari’s second chain, which is as follows:
Using horizontal combination:
0.6 * 0.6 * 0.6 = 0.216
So this second chain has only a 21.6% probability of truthfulness and accuracy. The reason is that we do not have any supporting transmitters. We only have Muhammad b. al-Muthanna’s word for it that Muhammad b. Jaafar said that, and we only have Muhammad b. Jaafar’s word for it that Shu`ba said that. The deeper a chain goes back in time, the lower its probability of authenticity and accuracy becomes.
We next deal with two chains from Sahih Muslim:
Using vertical combination for the middle transmitters, we get a probability of 0.84 or 84%. Multiplying that by 0.6, we get 0.504, meaning that Abu Mu`awiyah has a 50.4% probability of authenticity.
Next we have the more interesting task of combining all the chains we examined above. We have to vertically combine the probabilities of Hammad (0.558), Shu`ba (0.216) and Abu Mu`awiyah (0.504):
So the probability of the truth of the information coming from these three transmitters is 82.8%.
Now we horizontally combine this with Hisham b. Urwa’s 0.6 probability, resulting in 0.496873267
We repeat these same steps for the remaining chains, as follows:
And by vertically combining the left-most probabilities (Hisham b. Urwa’s 49.68% and Muhammad b. Abd al-Rahman’s 21.04%), we get 0.602766552, so the information has a 60.27% probability of authenticity at this stage.
We next multiply this 0.602766552 by Urwa b. al-Zubayr’s 0.6 (horizontal combination), resulting in 0.361659931.
In the final step, we multiply this result by Aisha’s 0.6:
The result is 0.216995959. This means that the hadith with all of its chains has a 21.69% chance of authenticity and accuracy. This seems very low, but it is natural for a hadith that comes from a single Companion, through a single transmitter.
In my methodology, a hadith that reaches 20% or higher is ḥasan, a hadith that reaches 30% or higher is ṣaḥīḥ, a hadith that reaches 60% or higher is ṣaḥīḥ al-ṣaḥīḥ (a degree above ṣaḥīḥ), and a hadith that reaches 85% or higher is mutawātir (“widely transmitted”, a degree above ṣaḥīḥ al-ṣaḥīḥ).
Note that the method can easily be tweaked so that ṣaḥīḥ would start at 50% instead of 30%.. Instead of giving a transmitter in a chain a probability of 60%, we can give them a probability of 80%, which would increase the results arrived it. Note that it makes no difference what assumption we choose, as I have chosen 60%, for an individual transmitter, because the end result is always relative to other hadiths. Regardless of what assumption we choose, it is the case that a hadith with a stronger chain will receive a higher rank than a hadith with a weaker chain.
Different scholars may prefer different probabilities for what they consider ḥasan or higher. Personally these are the numbers I have settled on that my heart is comfortable with and accepts.
The hadith disapproving of music
We now move on to Ṣaḥīḥ al-Bukhārī 5590, the hadith that says misguided Muslims will approve of musical instruments. Below is a diagram of the hadith’s chain:
The hadith comes from a single chain that does not branch out, meaning it is an extremely questionable chain, which I call a “precarious” chain. To calculate its probability of authenticity, we horizontally combine all the 0.6 probabilities as follows:
Probability of truth = 0.6 * 0.6 * 0.6 *0.6 *0.6 *0.6 = 0.046656
This hadith therefore has a 4.66% chance of authenticity, which is extremely low. In my thinking a hadith between 10% and 20% is munkar (strange and likely to be false), while a hadith below 10% is ḍaʿīf (“weak”, i.e. almost certainly false). As discussed in another article, there is another reason to consider this hadith questionable: it says misguided Muslims will consider khazz (a type of clothing) lawful. But we know 20 Companions of the Prophet PBUH wore this type of clothing, so this makes the hadith even more dubious.
The verdict
The hadith in which the Prophet PBUH says misguided Muslims will consider musical instruments lawful has only a 4.66% chance of authenticity, while the hadith in which the Prophet PBUH approves of musical instruments has a 21.69% chance of authenticity. Thus the hadith in which the Prophet PBUH approves of musical instruments is 4.6 times stronger than the hadith in which he disapproves of them (21.69 ÷ 4.66 = 4.65).
Based on this, we can confidently say that the evidence in support of the lawfulness of musical instruments is far stronger. Therefore approval of musical instruments is a vastly better representation of the Prophet’s sunna (tradition) than disapproval of them.
Defending the assumptions
The assumption that each transmitter has a 60% chance of accurately and truthfully transmitting the information needs to be defended. This assumption makes most ṣaḥīḥ narrations get an authenticity around 30%. If we treat these numbers empirically, it would mean that most authentic narrations are more likely to be false than true. For this reason I have chosen to treat all hadiths that reach 30% or higher as ṣaḥīḥ / authentic despite the fact that empirically they fall beneath the truth threshold of 50%.
My reasoning is that by choosing these assumptions, we create an interface between the empirical research world and the classical hadith studies world. A non-Muslim scholar may choose the 30% verdict on an authentic narration as a cause for skepticism, while a Muslim scholar can continue to make use of probability theory while adopting the traditional view of considering individual, low-truth-probability hadiths as authentic.
Another reason for the 60% assumption is that it gives us a very wide range of results. Some hadiths will reach close to 100%, many others will hover between 50% and 20%. This allows for representing a scholar’s empirical intuitions about these transmitted pieces of information, while also allowing them to remain in the classical hadith criticism world if they wish by choosing lower numbers, such as 30%, to represent full authenticity.
The study of Islam works on the basis of the autonomous consensus of the researchers, a concept I have defended elsewhere.1 Therefore introducing probability theory into hadith criticism will require the involvement of many researchers until a consensus emerges on the best assumptions to be chosen. Therefore my assumptions in this article are merely preliminary suggestions intended to illustrate what a probabilistic study of hadith would look like.
Conclusion
Combining probability theory and hadith criticism can greatly help in resolving issues surrounding contradictory hadith narrations by making it clear which hadiths are superior to which ones. It would be extremely helpful if we could build a new hadith collection that shows the probability of authenticity of each hadith rather than merely saying whether it is authentic or not. But such a work would require many years of work.
There is also the issue of sub-par transmitters. While I have chosen a probability 60% for reliable transmitters, for transmitters who are mudallis, non-qawī, non-ḥujja, or considered weak by some scholars and not others, lower probabilities will have to be used where necessary.
There are also different levels of weak transmitters. Some are considered weak for ideological reasons (because they held beliefs that hadith scholars considered unacceptable), while others are considered weak because they were caught lying or fabricating hadiths. Different probabilities will have to be used for different levels of weakness.
Further applications of the probabilistic method
See the articles on the Probabilistic Hadith Verification page for many studies by me in which I use the methodology developed in this article to verify hadiths on various important issues.
Assalamu alaikum! Lately I've been anxious about bad things happening to me or my family. I don't know if this is related to that, but I don't pray 5 times a day, although I'm trying to get better. But every time something bad happens to me, I wonder if it's a punishment from Allah because I'm not a very good Muslim, or wonder if I could have prevented it if I had prayed more. Is that a correct way to think about misfortune?
Alaikumassalam wa rahmatullah,
When things go wrong in your life it could either be a test, a punishment, or a sign or reminder. So it is right to fear that you may have displeased God. When something bad happens to my children, even if it just a fall, I always worry if it is because I have done something to displease God.
The Quran says:
Whatever good happens to you is from God, and whatever bad happens to you is from your own self. We sent you to humanity as a messenger, and God is Witness enough. (The Quran, verse 4:79)
The Quran also says:
We sent messengers to communities before you, and We afflicted them with suffering and hardship, that they may humble themselves.
If only, when Our calamity came upon them, they humbled themselves. But their hearts hardened, and Satan made their deeds appear good to them.
Then, when they disregarded what they were reminded of, We opened for them the gates of all things. Until, when they delighted in what they were given, We seized them suddenly; and at once, they were in despair. (The Quran, verses 6:42-44)
Aslamalaikum, I was wondering whether menstruation is a punishment from allah swt as I have heard that it was sent down as a punishment for hawa after she told adam to eat the fruit from the tree but I have also read that it is a blessing which I don't fully understand how it can be a blessing as it is so painful etc.
Alaikumassalam wa rahmatullah,
In my thinking the idea that someone could be punished for the sins of someone else is ridiculous. There is nothing in the Quran or widely-transmitted hadith that tells us Eve told Adam to eat of the fruit. That is a Jewish and Christian belief, in the Quranic version of the story they are both equally responsible.
And you, Adam, inhabit the Garden, you and your wife, and eat whatever you wish; but do not approach this tree, lest you become sinners.”
But Satan whispered to them, to reveal to them their nakedness, which was invisible to them. He said, “Your Lord has only forbidden you this tree, lest you become angels, or become immortals.”
And he swore to them, “I am a sincere advisor to you.”
So he lured them with deceit. And when they tasted the tree, their nakedness became evident to them, and they began covering themselves with the leaves of the Garden. And their Lord called out to them, “Did I not forbid you from this tree, and say to you that Satan is a sworn enemy to you?”
They said, “Our Lord, we have done wrong to ourselves. Unless You forgive us, and have mercy on us, we will be among the losers.” (The Quran, verses 7:19-23)
If menstruation makes life difficult, God can always make up for it by making other things easy.
What use does God have for your punishment if you have given thanks, and have believed? God is Appreciative and Cognizant. (The Quran, verse 4:147)
You cannot earn the rewards of patience unless you have something to be patient about. So menstruation is a blessing in that it gives you a chance to prove your patience and your ability to love God despite seemingly suffering needlessly.
Ideally there should be nothing that can happen to you that would decrease your love for God. This attitude is best expressed by the Iraqi poet Badr Shakir al-Sayyab in this poem:
For You is praise, no matter how long the distress lasts, And no matter how oppressive the pain becomes, For You is praise, afflictions are bestowals, And suffering is of Your bounty. Did You not give me this darkness? And did You not give me this dawn? Does the ground then thank raindrops, But become angry if the clouds do not find it? For long months, this wound Has been cutting my sides like a knife. The affliction does not calm at morning, And nighttime does not bring death to wipe out the agony. But if Job was to cry, he would cry, “For You is Praise, for suffering is like drops of dew, And wounds are presents from the Beloved, The stacks of which I hug to my chest. You presents are before me, they do not leave, Your presents are accepted, bring them on!” I hug my wounds and call out to visitors: “Look here and be jealous, For these are presents from my Beloved!” And if the heat of my fever approaches fire, I would imagine it a kiss from You fashioned from flame.
AsalamAlaikumWaRahimatullah When finishing menses women has to do ghusl. When during ghusl I have to wash my hair. My hair are in small, many braids. If I wash my hair like this soap and water will have access to my whole hair and head. Do I still need to open my braids?
There is no need to open your braids as long as all of your hair gets wet.
Umm Salama reported:
I said: Messenger of Allah, I am a woman who has closely plaited hair on my head; should I undo it for taking a bath, because of sexual intercourse? He (the Holy Prophet) said: No, it is enough for you to cast three handfuls of water on your head and then pour water over yourself, and you shall be purified.
Sahih Muslim 330 a
Additional source on the permissibility of not opening braids when performing ghusl:
Assalamualaikum. I'm a PhD student & often my research leads to complicated problems which keep coming into mind during my non-working activities & even in my salah. When I catch my mind drifting into my research problem I quickly say istighfar & focus on salah again, but then it keeps happening. Sometimes I can't even keep my focus between 2 takbir. Do you have any advice on how to deal with this? Is it alright to be distracted in salah as long as I'm trying to focus again? Thank you very much
Alaikumassalam wa rahmatullah,
I too sometimes struggle to disengage my mind from my work when I’ve been busy. It is just a struggle that we have to accept and try to overcome during the prayer, whether we can overcome it or not is not entirely in our control. When the brain is tired it is not easy to force it to concentrate on the thing you want.
The best thing for focus during the prayer that I have found is to say the words loudly enough that you can hear it with your ears clearly. The act of pronouncing the words clearly and carefully makes it quite difficult for the mind to wander.
I also make up for my occasional lack of concentration by making sure to perform the sunna prayers, and by performing dhikr after every prayer (saying subhanallah, alhamdulillah, allahu akbar and astaghfirallah 34 times each). Different numbers of repetitions are mentioned in hadith, I do 34 of each to keep it simple.
I also listen to the Quran an hour a day, which I hope is another way of making up for my failings in my prayers.
Asalamu alaykum, Regarding the recent Q you answered. Is it permissible to say the prayers our loud in Shari'ah as it is supposed to be the movement of the tongue and lips only? Also, advice for the questioner, what one focuses on outside of his/her prayer will be his/her focus in prayer. Therefore, it may be worth mentioning to be conscious of God even outside of prayer.
Alaikumassalam wa rahmatullah,
The correct way is to pray loudly enough for yourself to hear it, but not so loudly as others praying beside you would be bothered by it. God tells us:
Say, “Call Him God, or call Him the Most Merciful. Whichever name you use, to Him belong the Best Names.” And be neither loud in your prayer, nor silent in it, but follow a course in between. (The Quran, verse 17:110)
Moving your tongue and lips is not sufficient, your voice should be audible to yourself in a quiet room (which is what I recommended).
Women are not meant to recite out loud during prayer though, correct?
That only applies in the presence of strangers. At home or in the presence of other women the rule is the same as for men.
However, what I mentioned regarding the prayer being audible to yourself is a different matter and applies to all of the prayers. I was not referring to being loud during the fajr, maghrib and isha prayers.
I looked into Paradise and I saw that the most of its people were the poor; and I looked into the Fire and I saw that most of its people were women.
Sahih al-Bukhari 3241
Note that this hadith does not actually say that the majority of women in Hell are women. It may just mean that the part of Hell that the Prophet PBUH was shown contained many women. None of the versions of the hadith say “the majority of people in Hell are women”. They all mention that when the Prophet saw Hell, he saw that the majority of the people (of the part he saw) were women. It is clear that the Prophet PBUH interpreted this vision as meaning that the majority are women. But since nothing in the Quran or hadith tells us that explicitly, we may consider it to be the Prophet’s own personal conclusion from what he saw.
Various versions of this statement are to be found in all of major hadith collections. I decided to conduct a study of all existing authentic versions of this hadith to find out just how reliable they are.
Below is the version from the Companion ʿImrān b. Ḥuṣayn [ra]:
All of the versions come through the single transmitter Abū Rajāʾ.
Next are the versions coming from the Companion Ibn Abbas [ra]:
The strongest chain comes again through the aforementioned transmitter Abū Rajāʾ. There is however an additional chain (the top one) coming through ʿAṭāʾ b. Yasār, through Zayd b. Aslam.
Next are the other chains coming from four other Companions:
None of these latter four chains are very strong because each comes through a single transmitter, through another single transmitter, before other witnesses come along.
In order to prove a point with reasonable certainty, a hadith should come from a binary tree chain, as follows:
The current hadith falls short of this standard as follows, with the red boxes indicating missing transmitters:
Besides the missing transmitters, the hadith also has the issue of having a duplicate witness (the yellow boxes). So in reality we only have two transmitters’ words for it that the two Companions said that.
However, the four additional chains are supporting evidence in favor of the hadith and cannot be ignored. Using a hadith verification methodology I have developed that uses probability theory to combine the reliability of each transmitter and chain to reach a single number that represents the chance of the hadith being true (see my essay about it), we perform the following calculation to combine all of the probabilities:
So the verdict is that this hadith has a 73.12% probability of being truly from the Prophet PBUH, which is a very high probability for a hadith. In my highly stringent verification methodology, a hadith that reaches 60% or higher is ṣaḥīḥ al-ṣaḥīḥ (a degree above ṣaḥīḥ)
In conclusion, the Prophet PBUH almost certainly said that the majority of the people he saw in Hell were women. Whether this really means the majority are women, or whether only the part that he saw had a lot of women, we cannot say. So the hadith should not be used to imply that women are less pious or more evil than men.
There are numerous narrations that mention ruqya (the use of certain words, prayers or Quran recitations as charms or spells to heal or protect a person). I decided to to conduct a search of all major hadith collections and some minor ones to find all the hadiths that mention ruqya in order to find out just how authentic they are. I then used my own mathematical method of calculating hadith authenticity which combines probability theory with the science of hadith transmitter criticism (al-jarḥ wa-l-taʿdīl). The method (see my essay about it) is useful in judging between contradictory hadith narrations because it produces a single percentage for each hadith that reflects its chance of authenticity. We can then compare the chance of the authenticity of different hadiths to find out which one is most likely to be truly from the Prophet PBUH.
Summary
The hadith against ruqya has a 64.1% chance of authenticity, which makes it ṣaḥīḥ. The hadiths that support ruqya, however, are much lower in quality, the strongest having only a 20.78% chance of authenticity. But by combining the chance of the authenticity of all the ruqya-supporting hadiths, we reach a probability of 49.69%, which means that the crux of the meaning of the hadiths is likely to be true. It is strange, however, that the most authentic hadith in support of ruqya says that it is only to be used against the evil eye and scorpion stings.
In conclusion and considering all of the hadiths together, it appears that the Prophet PBUH forbade the use of ruqya in the pre-Islamic sense of casting a spell. But he permitted the use of the recitation of the Quran as a means of hopefully bringing about healing and protection. While some Muslims think that ruqya has an almost magical power that is guaranteed to bring about results, it is probably more correct to think of it as the same as prayer. It is merely the use of God’s words in the hope of attaining His blessings.
The traditional understanding of ruqya as casting spells is therefore highly doubtful and appears to be an importation of pre-Islamic Arab beliefs into Islam. The Prophet PBUH himself appears to have strongly disliked the spell-casting aspect of ruqya, which is why the most authentic narration speaks against it and mentions it along with other pre-Islamic practices. However, he appears to have tolerated the use of Quran recitation as a substitute for pre-Islamic forms of ruqya while allowing it to be called ruqya.
I am therefore fairly confident that we should reject the understanding of ruqya as spell-casting and instead think of it as similar to prayer and no more likely than prayer to be effective.
Technical details
The hadith against ruqya
It is interesting to note that the most authentic narration on ruqya actually says good Muslims will not use it:
Verily the Messenger of Allah (ﷺ) said: Seventy thousand men of my Ummah would enter Paradise without rendering account. They (the companions of the Holy Prophet) said: Who would be those, Messenger of Allah? He (the Holy Prophet) said: They would be those who neither practise charm (ruqya), not take omens, nor do they cauterise, but they repose their trust in their Lord.
Sahih Muslim 218 b
This hadith comes to us through three Companions (ignoring unauthentic chains). I decided to gather all of its versions from the major hadith collections to find out just how strong its chains are.
Below is a diagram of the chains coming through Ibn Abbas:
The numbers indicate probability of authenticity. Thus this chain has a 24% probability of being truly from Ibn Abbas (according to my methodology).
Below are the chains from Imran b. Husayn:
This chain is stronger and has a 45.7% probability of authenticity.
The last chain is from Ibn Masud and has a 12.85% chance of authenticity.
We use the following equation to combine all of these probabilities into one probability:
probability of authenticity = 1 - (1 - probability of authenticity of first chain) × (1 - probability of authenticity of second chain) × (1 - probability of authenticity of third chain chain) and so on.
The result is that this hadith has a 64.1% probability of authenticity. Any hadith that has a 60% probability of authenticity or higher is ṣaḥīḥ al-ṣaḥīḥ (a degree above ṣaḥīḥ) in my methodology, so this hadith is extremely authentic.
The hadiths in favor of ruqya
Narrated Al-Aswad:
I asked `Aisha about treating poisonous stings (a snake-bite or a scorpion sting) with a Ruqya. She said, "The Prophet (ﷺ) allowed the treatment of poisonous sting with Ruqya."
Sahih al-Bukhari 5741
It was narrated that Jabir said: “There was a family among the Ansar, called Al ‘Amr bin Hazm, who used to recite Ruqyah for the scorpion sting, but the Messenger of Allah (ﷺ) forbade Ruqyah. They came to him and said: ‘O Messenger of Allah! You have forbidden Ruqyah, but we recite Ruqyah against the scorpion’s sting.’ He said to them: ‘Recite it to me.’ So they recited it to him, and he said: ‘There is nothing wrong with this, this is confirmed.’”
Ibn Maja (authentic) Vol. 4, Book 31, Hadith 3515
The below diagram is the result of my search of all hadiths mentioning ruqya (click to enlarge it):
Below is a summary of the authenticity probabilities of the hadiths:
Aisha 10.88%
Aisha 7.77%
Aisha 15.67%
Aisha 7.278%
Anas 14.29%
Jabir’s uncle 1.2%
Abu Saeed al-Khudri 11.27%
Anas + Buryada + Imran 20.78%
Jabir + Asmaa’ b. Umays 14.89%
Awf b. Malik 5.8%
Shifaa’ b. Abdullah 3.88%
The strongest hadith is the one coming from the Companions Anas, Burayda and Imran, and it is as follows:
The Prophet (ﷺ) said: No spell (ruqya) is to be used except for the evil eye or a scorpion sting.
Sunan Abi Dawud 3884, Ibn Maja Vol. 4, Book 31, Hadith 3513, al-Tirmidhi Vol. 4, Book 2, Hadith 2057, etc.
The hadith, however, has only a 20.78% chance of authenticity, which is far below the 64.1% authenticity of the anti-ruqya hadith mentioned at the beginning.
There is one final step we can take by combining the authenticity probabilities of all the separate pro-ruqya hadiths, as follows:
Before merging the probabilities we divide each of them by two. This reflects the fact that we are combining entirely different hadiths together. It is easier to fabricate entirely new hadiths and chains than to fabricate supporting chains for the same hadith. So the probability of all the separate hadiths being true is lower than the probability of all the chains of the same hadith being true.
So the result is that there is a 40.41% chance that the crux of the meaning of the hadiths is true. In my methodology a hadith that reaches 30% or higher is ṣaḥīḥ. So the combined meaning of the hadiths together can be considered authentic.
Assalamualaikum. Do you have any tips on useful hobby? Or maybe you can share what you like to do on your down time? I try to be more productive by reading beneficial books between work break and during weekend, but sometime my brain just can’t take anything and I turn to social media or youtube. Then it often leads me to regretting the time spent on these activities… Any advice would be very appreciated, thank you very much in advance for your answer
Alaikumassalam wa rahmatullah,
My time is divided into three types: 1. I am able to do my work 2. I am too fatigued to work but I can read. 3. I cannot work or read.
My work is programming and writing educational books. My “hobby” is to conduct research in Islamic studies, philosophy and evolutionary science by reading books and papers. So if I am unable to do my main work, I work on my research.
But if I am too fatigued to work or read, there is not really anything productive I can do. In the evenings I cannot work or read, so I spend an hour listening to the Quran, I consider this an essential part of my day. After that if I have time left I may listen to one of my favorite Terry Pratchett, Frank Herbert or Tolkien audiobooks on my phone, or play with my children, or both. Listening to these audiobooks is not productive since I have listened to them dozens of times. It is just something I enjoy.
If you are too tired to read or do other beneficial things, I do not see anything wrong with enjoying your time on social media or YouTube. But I recommend dedicating an hour to listening to or reading the Quran, even if you feel tired and cannot give it perfect attention. Afterwards you can do whatever you enjoy with the time that is left.
Islam does not require us to be productive our entire waking time even though we may wish to be that way. So there is no need to worry about an hour or two a day spent unproductively on things you enjoy.
AOA, Akhi! few days ago I met an aunt of me.She and her daughters are very social and they all are well known in their fields.My father couldn't afford our studies so we sisters are just graduate.Also my father never allowed us to go out much so we are kind of staying at home type girls.But Alhamdulillah all are married and happy in their lives.My aunt said to me that the kind of life u are living,is just making u a burden on society.So does a person must be recognized by society before dying?
Alaikumassalam wa rahmatullah,
In my opinion a saintly “soccer mom” who has no accomplishment beyond taking care of her family is infinitely more admirable than a selfish and greedy female CEO. A woman’s worth has nothing to do with her accomplishments and everything to do with her character. A saintly woman who carries out her duties (whatever they may be) is better than other women regardless of accomplishments.
The idea that a woman’s worth should depend on her accomplishments is a self-defeating modern superstition. It tells women they are not good enough unless they ignore their own desires and instincts and enter races with men in the corporate, political or scientific world.
I fully support women’s participation in these things. What I do not support is acting as if a woman’s worth depends on these things. It does not. Her worth depends on her character. I would consider a woman with no accomplishments but with a good character superior to a female Nobel Prize winner with a bad character any day.
Our accomplishments are gifts from God. He created us, gave us talents and made things easy for us. Acting as if accomplishments increase our worth is the height of arrogance, it is the same as a rich person thinking their money that God has given them makes them worthier than poor people.
I see nothing wrong with a woman having no interest in accomplishments and simply wanting to take care of her family. And I see nothing wrong with another woman who likes accomplishments. Neither is worthier than the other. Both are simply carrying out their duties.
It is only ignorance and arrogance that makes a scholar or scientist think their job is more glorious than a mother who takes care of her children. To me their worth depends on their character, including how well they try to carry out their duties. If God has enabled me or some woman to be a scholar and has put scholarship in our path, it would be shameful if we do not try to be the best scholars we can be. But if God has not enabled another person to become a scholar, then it is not shameful that they are not scholars.
I firmly believe that an uneducated and illiterate shepherd who fears God more than I do is a better and worthier person than I am regardless of my accomplishments.
Your aunt’s statement that you are a burden on society is rather ignorant and arrogant. Just because God made things easy for her and not for you makes her think she is better than you. If you fear God more than her and carry out your duties just as well as her, then you are superior to her even if she gains global fame in her field.
There is no worth, honor or glory except through God. Anyone who chases these things outside of God is chasing a mirage.
I do not want to discourage women from working in traditionally masculine fields. What I want to discourage them from is the arrogance to think that this makes them superior to other women. It does not. Whether you work with test tubes or diapers, you are a lowly servant of God and your only worth comes through Him. Anyone more pious and saintly than you is superior to you regardless of who you think you are.
And I find pious women who seek worth and honor through God to be infinitely more admirable than women who seek these things by trying to race with men in traditionally masculine fields. Of course there is nothing wrong with a woman wanting to work in these fields, what is wrong is her thinking this is something to be proud of. Like I said, being proud of your accomplishments is like being proud of being rich. Both are blessings from God that you would never have had if He had not made things easy for you. Accomplishments should only increase your humility and gratitude toward God.
If anyone, man or women, thinks their accomplishments makes them superior to someone more pious than them, then they have become arrogant and misguided. If you think your fame and accomplishments make you superior to a completely unknown mother who fears God more than you and whose only accomplishment is raising healthy and happy children, then that is the height of arrogance.
So never let someone make you think you are inferior just because they are more accomplished and famous than you. It is the same as letting a rich person make you think you are inferior because you are not as rich. Seek worth an honor only through God, He should be your standard and your guide, not other people. If you are more pious than your aunt, then she has absolutely nothing to be proud of, and her self-satisfaction has only set her up for failure in attaining God’s love and pleasure.
There is, however, the danger of letting our sense of our piety make us feel arrogant and superior to others. This too is wrong. Feeling superior to others is always wrong, whether because of piety, accomplishments or wealth. You should only compare yourself to what God wants you to be, and seeing your numerous failures in being the best person you can be in God’s sight should only increase your humility and fear of God’s dissatisfaction with you.
The scientific output of Muslim-majority countries has grown tremendously over the past 20 years, measured in the number of scientific and scholarly papers published in international journals. The top scientific publisher is Iran, followed by Turkey, followed by Malaysia:
Below is the total of the scientific output of all ten countries:
The data only includes citable papers published in peer-reviewed journals included in the Scopus database (source: Scimago Journal & Country Rank).
In just ten years, these Muslim countries went from publishing 64110 papers in 2007 to 211287 papers in 2017, growing by over three times.
Below is a comparison of the Muslim total (blue) with the established scientific powers France, Germany, the United Kingdom and the United States:
The Muslim total has surpassed all of the European powers in quantity (not in quality, of course).
If the Muslim countries maintain their growth rate of 7.7% annually (the average rate of the past 5 years), they will surpass the United States by 2030:
It seems unlikely that that kind of growth can be sustained. The image below is more likely, which assumes an increase of 14000 papers per year (the average annual increase over the past 5 years). Accordingly, the Muslim countries will reach the level of the United States by 2042:
It should be noted that these statistics do not take account of the 200 million Muslims of India and their scientific output.
If it causes one to lose their judgment then it is haram. Anything that causes intoxication (a loss of judgment) in large doses is haram whether taken in large doses or small doses. Ayahuasca contains DMT and from what I found, people recommend not driving a car while on it. This seems to suggest that it is intoxicating and therefore haram.
Update: According to a commenter below, ayahuasca is not intoxicating. If this is true then there would be no issue with using it. I am unable to find any reliable information on the effects of ayahuasca, therefore I cannot state whether it is halal or not.