Historically and geographically, there's a lot of variation in decimal and thousands separators.
The decimal point is the US notation. It has become common across the world recently due to the spread of computers and calculators. But before that, a decimal point was uncommon outside the US.
The idea of a decimal mark seems to have emerged around the 12th century. Many notations were used in the following centuries in China, India, the Arabic world and Europe, including:
- a bar over the unit digit: 3̅14
- a vertical bar: 3|14
- a low vertical bar: 3╷14
- a comma: 3,14
- a low period: 3.14
- a raised period: 3·14
Today, most of Europe and South America as well as former French and Portuguese colonies in Africa officially uses the comma as a decimal separator.
There is also a lot of variation in thousands separators: comma 123,456, dot 123.456, apostrophe 123'456, etc. (Obviously different symbols are used for the thousands and decimal separators.) But most of the world is converging on using a (thin) space 123 456.
It is not the case that there was a worldwide standard on the period or comma and then some countries changed: there were many notations, and different countries standardized differently. Why? Accidents of history. In languages written in Latin script, I'm not aware of any language-related difference that would have favored one or the other.
Sources: