Could it ever work between a poor guy and a (somewhat) rich girl?

I think you need to sit down and think about what 'measure up to that level' really means. The only measure you've discussed is money, so it that truly the only measure you're using? If so, give up now. There is far more to a relationship than money. You do her a disservice by thinking that's all she would care about.