If ball joints are allowed to degrade to the point of failure, it can lead to a wheel separating from the vehicle while driving. That is... not good. The Dodge Ram that I bought a few months back ...
Drill out the old rivets. We used a chunk of wood to keep the control arm out of the way. It started as a clicking noise as you backed out of the drive. Just a mild tap through the steering wheel.