OpenAI GPT-OSS on a RTX 3060!!!

Turns out you can run models LARGER than you VRAM. Open AI realased a new Open Source, Apache licensed LLM and it runs suprisingly well on my aging hardware. 0:00 Intro 0:12 My Hardware 0:33 GPU and CPU Offloading 0:58 GPT OSS Run 1:23 LM Studio 1:59 AI Website Demo and Prompt 2:09 Outro TOOLS THAT I USE 🔥 https://kdenlive.org/ 🔥 https://www.gimp.org/ 🔥 https://www.blender.org/ 🔥 https://obsproject.com/ 🔥 https://www.audacityteam.org/ HARDWARE I USE 👾 ThinkPad X1 Carbon: https://amzn.to/3a0ZSvr 👾 Canon m50: https://amzn.to/3lFxy48 👾 Sigma 16mm f1.4 EOSM: https://amzn.to/3mKd0sM 👾 FiFine K669B USB Mic: https://amzn.to/3jnDhgd 👾 Keyboard | DIERYA DK63: https://amzn.to/3loFeeQ 👾 Mouse | Logitech M355: https://amzn.to/3A6GPds 👾 Acer SB270 27" 1920x1080 IPS Screen: https://amzn.to/3rSpQbZ 👾 Osmo Pocket: https://amzn.to/2JCAIZJ 👾 Mavic Mini: https://amzn.to/3lFxod2 👾 Samsung Galaxy Tab S6: https://amzn.to/3fsbVnR 👾 Samsung Galaxy S21 Ultra: https://amzn.to/3jmwAuy 👾 Movo TMP100 USBC Mi