It's hard to figure out whether an elderly person is just out of touch with what people need to get paid---"when I was your age I worked for adollar a day, and was glad to get it!" or if they are trying to take advantage of you. I think you did the right thing. If you had kept on, your feelings of being taken advantage of may have caused problems, and perhaps caused you to get hurt on the job.
Just from knowing you on this forum, I can tell you are a good conscientious worker.