Leaderboard rankings are updated periodically, usually on a daily basis. If you changed the score after the rankings were updated, the new rankings will only appear after the next update.
Consequently, the ranking directional arrows (up/down, red/green arrows) will reflect by comparing the ranking before the score update and after. For example, if you initially submitted a scoreline that ranked John at number #1, but later changed the scoreline to affect John’s position to number #5, the ranking arrow will show a downward (red) direction.