Is it really a big deal if you mix up the articles in German?

It matters, but would be forgiven in someone who was obviously not a native German speaker. Germans, and French people etc, etc, always welcome some effort at speaking their language, so don't worry if you make a boo-boo sometimes. Better to try than to look as if you haven't taken any trouble to learn the language at all.