He was the client of the Banu Tamim, then the Banu Hanifa. His kunya was Abu 'Abdu'r-Rahman.

He listened to Ibn Abi Layla, Hisham ibn 'Urwa, al-A'mash, Sulayman at-Tamimi, Humayd at-Tawil, Yahya ibn Sa'id, Ibn 'Awn, Musa ibn 'Uqba, the two Sufyans, al-Awza'i, Ibn Abi Dhib, Malik, Ma'mar, Shu'ba, and Haywa ibn Shurayh, and he studied with Abu 'Amr ibn al-'Ala', al-Layth and others.

Ash-Shirazi said, "He learned fiqh with Malik and ath-Thawri, and he was the first of Abu Hanifa's companions. Ibn al-Mubarak said, "I studied adab for thirty years and I studied knowledge for twenty years." He said: Fight your tongue. The tongue is quick to kill a man.The tongue is the posting of the heart. It shows man his intellect. He was asked, "Which person has the best state?" He said, "The one who devotes himself to his Lord."

Ibn Hanbal said, "In the time of Ibn al-Mubarak, there was no one who sought after knowledge more than him. He went to the Yemen, Egypt, Syria, the Hijaz, Basra and Kufa, and whoever related knowledge and was worthy of it. He wrote from young men and old men. He omitted what was rare. He gave hadiths from books."

Ibn al-Mubarak died in Hit, returning from a naval expedition and was buried in Hit in Ramadan in 181.

Al-Bukhari said that he was born in 118.

When he was near death, he told Nasr, his client, "Put my head on the earth." Nasr wept. He said, "Why do you weep?" He said, "I remember what you had in it of blessing and now you are dying a stranger and a pauper." He told him, "Be quiet. I asked Allah to let me live the life of the rich and to make me die the death of the poor." Then he said, "Put me down and do not address me again unless I speak again. Put me down so that it is my last words.".