Well, to be perfectly clear, you can, just outside of Create React App setup:

node-sass ./src/app.scss -w -o ./src/css

And import the resulting CSS.

(Thanks for the tip to Armando Sosa)