A Philadelphia native, Klugman also made his mark in movies, including an early role as a member of the jury in 1957's "12 Angry Men," and as Ali McGraw's father in "Goodbye, Columbus" in 1969.
He was the last of the 12 actors from "12 Angry Men" to pass away.
His earliest acting was on the stage in New York, where he continued to perform throughout his life.
Some of his memorable early TV appearances included roles on "The Twilight Zone" and the crime drama "Naked City." The Internet Movie Database lists 97 television and film credits for Klugman.
A battle with throat cancer in the late 1980s reduced his voice to a rasp, but it did not end his career.
Klugman was also a big fan of the ponies.
"I always was a player," he said. "I had been gambling on horses since I was a kid, 15 years old. And when I came (to Los Angeles), I came involved with people" with home he began to buy horses.
One of the race horses turned up lame so Klugman agreed to breed the horse and sell the foal.
Instead he decided to keep it and name it Jack. But when it was born, he was told the horse was a female so he named it Jacklin. When he received the horse, it turned out it was a male after all.
Jacklin Klugman finished third in the 1980 Kentucky Derby and fourth in the Preakness Stakes.
Klugman was first married to the late Brett Somers -- an actress and regular panelist on the TV quiz show "Match Game" -- from 1953 until her death in 2007, the website said. People magazine reported that the two separated in 1974 but never divorced.
At the time of his death, he was married to former actress and longtime girlfriend Peggy Crosby, whom he married in 2008 when he was 85. Klugman is also survived by another son, David.