Yeah, I’m pretty sure there was a religious reason behind it. I’m not religious myself anymore but grew up in a very religious area, specifically Mennonite, but not the old order kind. Gambling was a sin and therefore anything associated with gambling like cards and dice were sinful by extension.