Several people have reported issues with a very slow home button response on iPhone 4.
Fix:
Turn off ‘Triple-click Home’ (this feature is off by default) > Settings > General > Accessibility > Triple-click Home.
If does not work
Reset your device by pressing and holding the Sleep/Wake button and the Home button at the same time for at least 10 seconds until you see the Apple logo.