Audio files become altered when converting a project’s sample rate

[Jonathan Levine]

I’m trying to use higher sample rates for my projects, but despite having an M1 Max in my 14” MacBook Pro, I still can’t use a 32 buffer size with a 96 KHz sample rate without getting a lot of lag/distortion.
 

With that being said, I figured I’d try using a 44.1/48 KHz sample rate with a 32 buffer size at first to reduce any distortion/lag when I’m working on stuff, and convert the project to 96 KHz afterwards, but I can’t do that without all the audio files becoming warped, distorted, or shortened. 
 

Is there a way to prevent this from happening, or would I just have to stick with one sample rate or the other to avoid the issues that come with converting between them? 

[Bcraig_music69]

Hi not an expert

but I try to help

When I open Logic up I usually set it up to 96 KHz sample from the start on a new Logic Project

so when I start  to record any audio or midi I know it will record at that sample rate

 

Are the audio files Your working with are they at 96 KHz sample rate?