"Actually I wasn't"?

Ok, you know how ABC has this new ad campaign called 'ABC House'. Well you know the one were Charlie is playing Foosball. Then Dempsey say, "You're so dead" and Charlie replies ether, "Actually I wasn't" or "Actually I was". I think he said wasn't but so many people think he said was. What's your take? Btw, I know that this video is old but it's still bothering me. Thanks.