In 5684 (1924), Rav Ruderman married the daughter of Rav Sheftel Kramer, a son-in-law of Rav Shraga Feivel Frank and brother-in-law of Rav Isser Zalman Meltzer, Rav Moshe Mordechai Epstein and Rav Boruch Horowitz.
The Rebbetzin was his partner and helpmate in all his undertakings on behalf of Yiddishkeit. Not only did she free him from the yoke of responsibility in the material aspects of the house, but she was also instrumental in helping him achieve lofty spiritual pursuits. Later, when they moved to America and Rav Ruderman sought to build a Yeshiva in a country that had no understanding of the concept, it was the Rebbetzin who constantly encouraged him to persevere rather than be deterred by the numerous stumbling blocks placed in his way. It was the Rebbetzin who organized fundraisers and donations of staples for the Yeshiva. The Rosh Yeshiva was eternally grateful for all that she had done and, many decades later, upon her passing several years before his petira, the Rosh Yeshiva was simply inconsolable.
During the first years after their marriage, the Rosh Yeshiva devoted himself to complete immersion in learning. In 1931, the Rosh Yeshiva, Rebbetzin and their baby daughter immigrated to the United States. Rav Ruderman joined his father-in-law, Rav Sheftel Kramer, in the Yeshiva of New Haven that had relocated to Cleveland, where the latter served as Menahel Ruchani.
In 1933, Rav Ruderman decided to accept a position as Rav of the Tiferes Yisrael Shul in Baltimore with the understanding that he could use the facilities for a Yeshiva.
The Yeshiva’s early growth intensified through the recognition and support of prominent Rabbonim. Rav Shraga Feivel Mendlowitz, Menahel of Mesivta Torah Vodaas and unquestionably one of the most important figures in the development of Torah in America, sent bochurim from New York whom he thought would benefit. Rav Yaakov Kaminetsky sent his children from Toronto, which in those days was considered a major distance away. Rav Yehoshua Klavan, one of the foremost talmidim of Rav Boruch Ber and the Rav of Washington, D.C., was among the staunchest supporters of the Yeshiva. He not only sent a son to learn in the Yeshiva, he even raised funds for the upkeep and growth of the Yeshiva. Furthermore, during the winter months, when Rav Ruderman would occasionally suffer from laryngitis, Rav Klavan would come from Washington to deliver the daily shiur. Rav Naftoli Zvi Yehuda Riff, a grandson of the Netziv and the Rav of Camden, New Jersey, was also extremely helpful.
