Not really, because there's a time associated with it. All they would have to do is call up your ISP and say, "The person with IP number x.x.x.x at December 1st 0923 broke into my computer." The ISP checks their data (oh yes, they keep that kind of info) and match the IP at that time with the person using it (you) and give you a call.