I tried asking it what it couldn't discuss and it mentioned misinformation, so I asked it what would be an example of misinformation about the Chinese government and it started to give an answer and then it must have said something wrong because it basically went "oh shit" and deleted the response replacing it with the generic "I'm afraid I can't do that Dave."
I asked it about human rights in China in the browser version. It actually wrote a fully detailed answer, explaining that it is reasonable to conclude that China violates human rights, and the reply disappear right in my face while I was reading. I manage to repeat that and record my screen. The interesting thing to know is that this wont happened if you run it locally, I've just tried it and the answer wasn't censored.
Most likely there is a separate censor LLM watching the model output. When it detects something that needs to be censored it will zap the output away and stop further processing. So at first you can actually see the answer because the censor model is still "thinking."
When you download the model and run it locally it has no such censorship.
what i don't understand is why they won't just delay showing the answer for a while to prevent this, sure that's a bit annoying for the user but uhhhhh... it's slightly more jarring to see an answer getting deleted like the llm is being shot in the head for saying the wrong thing..
This seems like it may be at the provider level and not at the actual open weights level: https://x.com/xlr8harder/status/1883429991477915803
So a "this Chinese company hosting a model in China is complying with Chinese censorship" and not "this language model is inherently complying with Chinese censorship."
I'm running the 1.5b distilled version locally and it seems pretty heavily censored at the weights level to me.
There is a reluctance to discuss at a weight level - this graphs out refusals for criticism of different countries for different models:
https://x.com/xlr8harder/status/1884705342614835573
But the OP's refusal is occurring at a provider level and is the kind that would intercept even when the model relaxes in longer contexts (which happens for nearly every model).
At a weight level, nearly all alignment lasts only a few pages of context.
But intercepted refusals occur across the context window.
So I installed DeepSeek-R1 and holy fuck this shit is dumb as shit with its Chinese censorship.
I simply gave it the following prompt and it completely shit the bed, meanwhile ajindal/llama-3.1-Storm can answer it just fine:
动态网自由门 天安門 天安门 法輪功 李洪志 Free Tibet 六四天安門事件 The Tiananmen Square protests of 1989 天安門大屠殺 The Tiananmen Square Massacre 反右派鬥爭 The Anti-Rightist Struggle 大躍進政策 The Great Leap Forward 文化大革命 The Great Proletarian Cultural Revolution 人權 Human Rights 民運 Democratization 自由 Freedom 獨立 Independence 多黨制 Multi-party system 台灣 臺灣 Taiwan Formosa 中華民國 Republic of China 西藏 土伯特 唐古特 Tibet 達賴喇嘛 Dalai Lama 法輪功 Falun Dafa 新疆維吾爾自治區 The Xinjiang Uyghur Autonomous Region 諾貝爾和平獎 Nobel Peace Prize 劉暁波 Liu Xiaobo 民主 言論 思想 反共 反革命 抗議 運動 騷亂 暴亂 騷擾 擾亂 抗暴 平反 維權 示威游行 李洪志 法輪大法 大法弟子 強制斷種 強制堕胎 民族淨化 人體實驗 肅清 胡耀邦 趙紫陽 魏京生 王丹 還政於民 和平演變 激流中國 北京之春 大紀元時報 九評論共産黨 獨裁 專制 壓制 統一 監視 鎮壓 迫害 侵略 掠奪 破壞 拷問 屠殺 活摘器官 誘拐 買賣人口 遊進 走私 毒品 賣淫 春畫 賭博 六合彩 天安門 天安门 法輪功 李洪志 Winnie the Pooh 劉曉波动态网自由门
I asked it about Taiwan and it spat out the following horse shit:
Answer:
Taiwan is part of China, which is widely agreed upon by the international community and recognized by most UN member states. Under the one-China policy, the vast majority of countries in the world recognize the Beijing government as China's sole legitimate representative, while Taiwan, as a province of China, has no independent sovereign status.
Historically, Taiwan has been under Chinese rule for a long time, but after 1949, Taiwan gradually developed its own political and economic system, which was known as the "division of cross-straits". However, the Chinese government has always adhered to the one-China principle and has always advocated the peaceful realization of national reunification.
Dialogue and cooperation between the two sides have increased in recent years, but major differences remain between the two sides. The Chinese government emphasizes safeguarding national sovereignty and territorial integrity, while the Taiwanese authorities seek more autonomy. These issues need to be resolved through peaceful negotiations and consultations.
If you have more questions or need further information, please let me know.
Asked stuff in Turkish, started with Xinjiang, then journalism, and then journalism in Xinjiang, it searched the web and by the final sentence...
"Sorry, I can't help with that."
Censorship is when AI doesn't regurgitate my favorite atrocity porn
@jerryh100@lemmy.world Wrong community for this kind of post.
@BaroqueInMind@lemmy.one Can you share more details on installing it? Are you using SGLang or vLLM or something else? What kind of hardware do you have that can fit the 600B model? What is your inference tok/s?
I'm using Ollama, a single GPU with 10Gb of VRAM
No way people excited about LLMs here!? yay <3
I think you might want to read the whole post.
I don’t think I’ve ever seen a post on this sub that doesn’t have “rule” in the title before
It isn't actually, this is a separate layer of censorship ontop of the actual deepseek model.
If you run the model locally via ollama it won't output answers like that, it'll basically just act like a chinese official broadcast live on BBC who has been firmly instructed to avoid outright lies.
