Thank you for your reply, Vincent! I installed rasterio==1.3a3 from pypi and set a few GDAL environment variables and now everything is working as expected in my non-conda installation.
Here are the GDAL environment variables that I need to set to read the file: