Max Pactor was born in Brooklyn, New York, on June 27, 1907, the firstborn American child of parents who had emigrated from Russia around 1904. His father was a tailor who worked long hours in the sweatshops, and Max was the middle of three boys, often wearing hand-me-downs until he received his first suit of his own at his bar mitzvah at age 13. The family was raised in Coney Island, then largely a summer resort, where Max lived almost like a country boy along the seashore. He attended public school through the eighth grade and cheder until age 13, and though he was one of only a few Jewish boys in his school and faced frequent fights, he retained much of his Hebrew learning throughout his life. His home observed the Jewish holidays even if it was not strictly kosher.

Max took his first job at 14 and worked at many things, beginning as a clerk for a wholesale tobacconist and confectioner. He met his future wife on the beach at Coney Island, and they married in April 1928. The couple settled in Bensonhurst, Brooklyn, and raised two children, a daughter named Arlene and a son. Max spent most of his working life in the ladies' ready-to-wear and dress business, often as a contractor working alongside his father, but he grew weary of the harsh treatment in that trade and had long disliked New York. In 1949 he moved his family to Texas, where his daughter had already relocated.

In Dallas, Max briefly co-owned a nightclub that was later sold to Jack Ruby, then returned to the clothing trade, working for a time for Abe Zapruder before moving through several other garment businesses. In retirement he embraced his lifelong knack for making things and became a dedicated self-taught artist, producing sculptures, oil paintings, wood carvings, and intricate metal-inlay-in-wood pieces, including a series of scriptural works. Two of his creations, Jacob's Dream and a Magen David formed from Hebrew letters, were placed in the synagogue at Golden Acres, the Jewish Home for the Aged. Motivated by a wish to leave something meaningful behind, Max valued his art as his legacy. An active member of the senior club at the Jewish Community Center, he enjoyed playing pinochle and offered his descendants the advice to live by the golden rule and to work hard for what they wanted.