larger,bigger,greater, higher difference

"greater" means bigger in size, weight, speed, or several other things. It can also be used for numbers to mean "bigger".

"higher" means having more "height" (vertical location or vertical size). It can also be used for numbers to mean "bigger".

On a chart (X and Y are axises) you would avoid using "higher" for "bigger number" since it could also mean "vertical distance"

Correct: Everyone knows 5 is larger than 4.
Correct: Everyone knows 5 is bigger than 4.
Correct: Everyone knows 5 is greater than 4.
Correct: Everyone knows 5 is higher than 4.

you really can't go astray when deciding between larger, bigger, greater, and higher when referring to numbers, however, it becomes more complicated when figuring out when to describe physical size, degree of skills, and popularity.