Something fell on the ground,

Gravity is responsible for that.

I fell on you,

Gravity never does that.

But when I fell on you literally,

Well, never accuse me

Accuse the gravity.