Family and legacy
He married Emily Whitney Alexander (1846–1943), sister of his business partner Samuel Alexander, on April 5, 1870.
His sister Abigail Charlette Baldwin had married Samuel's brother William DeWitt Alexander (1847–1912) in 1861.
Their first son Henry Alexander Baldwin (1871–1946), known as "Harry", became manager of the Haiku Sugar Company in 1921, which was merged with other plantations to become the Maui Agricultural Company.
Harry was very active in politics, including serving as delegate to the United States House of Representatives from the Territory of Hawaii.
Son William Dwight Baldwin was born October 25, 1873, graduated from Yale in 1897, and then Johns Hopkins Medical School in 1901. He returned in 1905 to practice medicine in Honolulu until 1914 when he became a rancher on Maui. He died October 30, 1943.
Arthur Douglas Baldwin was born April 8, 1876, graduated from Yale and then Harvard Law School 1898–1891 He moved to Cleveland, Ohio and practised law in his firm Garfield McGregor & Baldwin. His law partner James Rudolph Garfield was son of President James A. Garfield. He married Reba Louise Williams in 1902 and had five children. He wrote a biography of his father.
He became a lieutenant of field artillery in World War I and died in 1954.
Son Frank Fowler Baldwin was born March 30, 1878, attended Yale but left in 1898. He started work as a field worker and eventually became President of Kahului Railroad in 1910, and of the Hawaiian Commercial Company (HC&S) when Henry Perrine died.
In 1948 Frank combined HC&S with Maui Agricultural Company for a combined 25,454 acres (10,301 ha). He died February 6, 1960.
Daughters Maud Mansfield (Baldwin) Cooke (1872–1961) and Charlotte (Baldwin) Rice (1884–1938) married descendants of other missionaries, Joseph Platt Cooke (1870–1918), and Harold Waterhouse Rice, who also were in the sugar business. Cooke was grandson of Amos Starr Cooke and nephew of businessman Samuel Gardner Wilder.
Youngest son Samuel Alexander Baldwin was born August 30, 1885. He attended Punahou School, Oakland High School in California, and Yale in 1908. He married Katherine Smith in Honolulu, May 10, 1909. He became a champion polo player and managed Haleakala Ranch when von Tempsky retired.
Samuel died July 21, 1950.
In 1910 the Baldwins founded the Fred Baldwin memorial foundation in honor of their son Fred Chambers Baldwin (1881–1905) who died October 11, 1905, in New York City. From 1910 through World War II it supported an elderly housing facility. Since then it has made grants to the Maui community.
Henry Perrine Baldwin had an operation for appendicitis in January 1909 and traveled to California in the summer of 1911. He died a few days after returning on July 8, 1911.
David Thomas Fleming (1881–1955) was manager of Baldwin's Honolua Ranch where he planted pineapple in 1912. Fleming converted the cattle ranch to a pineapple plantation. This was the beginning of Maui Land & Pineapple Company, an industry that continued until 2009.
In 1913 the Old Maui High School was built on the Hamakuapoko plantation land.
Henry Perrine Baldwin High School was named for him in Wailuku, Hawaii in 1934.
The former superintendent's residence of a Hawaiian Commercial & Sugar Company sugar mill in Puʻunēnē is now the Alexander & Baldwin Sugar Museum. H.A. Baldwin Beach Park is located on the north shore of Maui between Spreckelsville and Paia.
In 1916 another new Makawao Union Church was built of concrete with stone veneer and is called the "Henry Perrine Baldwin Memorial Church". Many Baldwin family members are buried in the Makawao Cemetery near him.
William Hyde Rice (son of William Harrison Rice and father of Harold W. Rice who married Charlotte Baldwin) and Henry Alexander Baldwin were among the notable speakers.