@llama@lemmy.dbzer0.comEnglish • edit-22 months ago How to run LLaMA (and other LLMs) on Android.plus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-square How to run LLaMA (and other LLMs) on Android.plus-square@llama@lemmy.dbzer0.comEnglish • edit-22 months agomessage-square0fedilink
@OmegaLemmy@discuss.onlineEnglish • 2 months agoWhat is a good model that runs on 6GB Vram?plus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareWhat is a good model that runs on 6GB Vram?plus-square@OmegaLemmy@discuss.onlineEnglish • 2 months agomessage-square0fedilink
@artificialfish@programming.devEnglish • 2 months agoHas anyone applied tree of thought prompting to r1 yet?plus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareHas anyone applied tree of thought prompting to r1 yet?plus-square@artificialfish@programming.devEnglish • 2 months agomessage-square0fedilink
iktEnglish • 2 months agoMistral Small 3 (24B) releasedplus-squaremistral.aiexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkMistral Small 3 (24B) releasedplus-squaremistral.aiiktEnglish • 2 months agomessage-square0fedilink
iktEnglish • 2 months agoDid DeepSeek R1 just pop nvidias bubble?plus-squarewww.youtube.comexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkDid DeepSeek R1 just pop nvidias bubble?plus-squarewww.youtube.comiktEnglish • 2 months agomessage-square0fedilink
SmokeyDopeEnglish • edit-22 months agoWhy llms are suprisingly good at math, and what it means to process language.plus-squarelemmy.worldimagemessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageWhy llms are suprisingly good at math, and what it means to process language.plus-squarelemmy.worldSmokeyDopeEnglish • edit-22 months agomessage-square0fedilink
SmokeyDopeEnglish • edit-22 months agoThoughts on new deepseek R1 distill modelsplus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareThoughts on new deepseek R1 distill modelsplus-squareSmokeyDopeEnglish • edit-22 months agomessage-square0fedilink
@brokenlcd@feddit.itEnglish • 3 months agounsure on how to quantize modelplus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareunsure on how to quantize modelplus-square@brokenlcd@feddit.itEnglish • 3 months agomessage-square0fedilink
🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖English • 3 months agoHow much gpu do i need to run a 90b modelplus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareHow much gpu do i need to run a 90b modelplus-square🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖English • 3 months agomessage-square0fedilink
SmokeyDopeEnglish • 3 months agoNvidia Digits AI Supercomputer just announcedplus-squarelemmy.worldimagemessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageNvidia Digits AI Supercomputer just announcedplus-squarelemmy.worldSmokeyDopeEnglish • 3 months agomessage-square0fedilink
HaloEnglish • 3 months agoGo toolchain error - Does anyone know what's going on here?lemmy.worldimagemessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageGo toolchain error - Does anyone know what's going on here?lemmy.worldHaloEnglish • 3 months agomessage-square0fedilink
hendrikEnglish • edit-23 months ago(New) papers by Meta: Large Concept Models and BLTplus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-square(New) papers by Meta: Large Concept Models and BLTplus-squarehendrikEnglish • edit-23 months agomessage-square0fedilink
@BB84@mander.xyzEnglish • edit-23 months agoNew open-weight 🐋 DeepSeek V3. 685B MoE. Beats Claude 3.5 Sonnet on Aider coding benchmarkplus-squarehuggingface.coexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkNew open-weight 🐋 DeepSeek V3. 685B MoE. Beats Claude 3.5 Sonnet on Aider coding benchmarkplus-squarehuggingface.co@BB84@mander.xyzEnglish • edit-23 months agomessage-square0fedilink
@hok@lemmy.dbzer0.comEnglish • edit-24 months agoCan you fine-tune on localized steering of an LLM?plus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareCan you fine-tune on localized steering of an LLM?plus-square@hok@lemmy.dbzer0.comEnglish • edit-24 months agomessage-square0fedilink
mapumbaaEnglish • 4 months agoQuestions about HW for local LLM.plus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareQuestions about HW for local LLM.plus-squaremapumbaaEnglish • 4 months agomessage-square0fedilink
@HumanPerson@sh.itjust.worksEnglish • edit-24 months agoFixed itplus-squaresh.itjust.worksimagemessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageFixed itplus-squaresh.itjust.works@HumanPerson@sh.itjust.worksEnglish • edit-24 months agomessage-square0fedilink
@hok@lemmy.dbzer0.comEnglish • 4 months agoLlama 3.3 70b - End of open-weight pretrained models from Meta or just a better Llama 3.1 405b finetune?plus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareLlama 3.3 70b - End of open-weight pretrained models from Meta or just a better Llama 3.1 405b finetune?plus-square@hok@lemmy.dbzer0.comEnglish • 4 months agomessage-square0fedilink
projectmoonEnglish • edit-24 months agoOpenWebUI OpenStreetMap Tool 2.1.0plus-squareopenwebui.commessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkOpenWebUI OpenStreetMap Tool 2.1.0plus-squareopenwebui.comprojectmoonEnglish • edit-24 months agomessage-square0fedilink
@lynx@sh.itjust.worksEnglish • 4 months agoQwen2.5-Coder-7Bplus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareQwen2.5-Coder-7Bplus-square@lynx@sh.itjust.worksEnglish • 4 months agomessage-square0fedilink
Smorty [she/her]English • 5 months agoHaving trouble to generate correct output? Try prefixes!plus-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareHaving trouble to generate correct output? Try prefixes!plus-squareSmorty [she/her]English • 5 months agomessage-square0fedilink