-
Notifications
You must be signed in to change notification settings - Fork 233
Add an LLM policy for rust-lang/rust
#1040
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Changes from 15 commits
772edeb
815da6e
17a35f4
61e5e2c
8ee5ed4
7cd8c17
2db7465
9b2b3c2
e3b1394
e3f2aec
864428f
593d538
75050a2
b6a8662
9a944f7
14956c3
8fe7281
791e46f
8520038
b14e8ca
69b6dc1
d682475
ea4e504
7eeecbb
cd9aecd
ee4f26c
7956574
b88855a
4305e14
ab6f8a4
d9d8238
83b9363
9efffad
24f236c
f85aac6
adfc5e2
014cf85
db8fdae
196cf63
6374d57
8a1ce25
742d9f4
235432b
9396306
33b1407
08a6b17
3740dc5
fb37c69
8444f54
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
|
This comment was marked as a violation of GitHub Acceptable Use Policies
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I understand you're frustrated, but I don't think this kind of language helps anyone. About your point: you explicitly state that people are allowed to have their own opinion, but apparently they are not allowed, per you, to have an opinion on whether the discussion of ethics is relevant here. And for the record, I don't use LLMs and I dislike them for many reasons. But I also think that setting a policy on the basis of the ethical consequences of them is not what we should do. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The missing link to said RFC: rust-lang/rfcs#3959 There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I'm not the one who decided to omit ethics from the discussion here; I'm respecting the opinions of the author on that, and conceding that it's fair to get a simpler policy out sooner in this particular case. There are allowed to be concurrent policy decisions and this policy's opinion is that focusing entirely on pragmatic labelling of LLM contributions, alongside calling out certain problematic usages, is the best way to get a policy out sooner. Is that the best choice? No idea! But I respect the author and their wishes and have an explicit alternative that will almost certainly take longer to figure out. So, instead of bothering jyn about it, I'm inviting the discussion to happen there instead. |
| Original file line number | Diff line number | Diff line change | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| @@ -0,0 +1,152 @@ | ||||||||||||||||||||||||||
| ## LLM Usage Policy | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| For additional information about the policy itself, see [the appendix](#appendix). | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| ### Overview | ||||||||||||||||||||||||||
|
nikomatsakis marked this conversation as resolved.
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| Using LLMs while working on `rust-lang/rust` is conditionally allowed, when done with care. | ||||||||||||||||||||||||||
| LLMs are not a substitute for thought, | ||||||||||||||||||||||||||
| and we do not allow them to be used in ways that risk losing our shared social and technical understanding of the project, | ||||||||||||||||||||||||||
| nor in ways that hurt our goals of creating a strong community. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| The policy's guidelines are roughly as follows: | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| > It's fine to use LLMs to answer questions, analyze, distill, refine, check, suggest, review. But not to **create**. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| > LLMs work best when used as a tool to write *better*, not *faster*. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
Comment on lines
+16
to
+17
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Having this as a high-level summary is offering a judgement on LLMs that feels like it isn't necessary for the policy, and makes consensus more difficult to reach. For anti-LLM folks it's saying that they work best when used to write "better", which is a point in dispute. I would also expect (but don't want to put words in people's mouths) that for pro-LLM folks the point that they don't work well when used to work faster may be in dispute. I've tried to rephrase this in a fashion that, rather than expressing a general statement on when "LLMs work best", is instead expressing what is desired *for
Member
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This is adapted from a quote by @ubiratansoares. This edit changes the quote beyond recognition, and I would rather remove it than edit this much.
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Then I think it would be best removed, on the basis that previous line covers similar territory and seems less controversial.
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Tbh I don't actually understand what this quote is supposed to mean; if anything, I would phrase it the other way around (you can use LLMs to do [things you can already do] to get them done faster, but you shouldn't use them to do things you don't already know how to do yourself).
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Honestly, it was the
that I took back to my team and reworked our approach to AI-generated code. I think that statement itself has a lot of weight. |
||||||||||||||||||||||||||
| ### Rules | ||||||||||||||||||||||||||
| #### Legend | ||||||||||||||||||||||||||
| - ✅ Allowed | ||||||||||||||||||||||||||
| - ❌ Banned | ||||||||||||||||||||||||||
| - ⚠️ Allowed with caveats. Must disclose that an LLM was used. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
|
||||||||||||||||||||||||||
| - ℹ️ Adds additional detail to the policy. These bullets are normative. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| #### ✅ Allowed | ||||||||||||||||||||||||||
| The following are allowed. | ||||||||||||||||||||||||||
| - Asking an LLM questions about an existing codebase. | ||||||||||||||||||||||||||
| - Asking an LLM to summarize comments on an issue, PR, or RFC. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| - ℹ️ This does not allow reposting the summary publicly. This only includes your own personal use. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| - Asking an LLM to privately review your code or writing. | ||||||||||||||||||||||||||
| - ℹ️ This does not apply to public comments. See "review bots" under ⚠️ below. | ||||||||||||||||||||||||||
| - Writing dev-tools for your own personal use using an LLM, as long as you don't try to merge them into `rust-lang/rust`. | ||||||||||||||||||||||||||
| - Using an LLM to discover bugs, as long as you personally verify the bug, write it up yourself, and disclose that an LLM was used. | ||||||||||||||||||||||||||
| Please refer to [our guidelines for fuzzers](https://rustc-dev-guide.rust-lang.org/fuzzing.html#guidelines). | ||||||||||||||||||||||||||
| - ℹ️ This also includes reviewers who use LLMs to discover flaws in unmerged code. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Could we narrow this somehow? I routinely run models over the lang nomination queue to prepare for meetings. It's not the main purpose of my process, but nonetheless, the models reliably flag things that I would find anyway, e.g., violations of RFC 0344 lint naming conventions, setting the lint level and The model is going to have found this flaw in the unmerged code first, and I'm going to have seen that, so I'd read that as falling under this policy. But I'm not looking forward to having to pollute all my comments, e.g.:
Or could we come up with a scheme for blanket disclosure? Could we disclose once somewhere, e.g., in team, whether all our review comments should be treated as possibly LLM assisted? I suppose I'd even be OK if triagebot wants to walk around in my shadow posting scarlet letters after each of my comments as long as I don't need to retype this everywhere.1 Footnotes
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I'm a bit confused why you're asking for this clarification since this is under the allowed section. You just don't need to disclose it, from what I can see.
Member
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. No, under the rules it currently requires disclosure.
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Ah, that feels a bit confusing, then. Because the way this list is worded, it looks like it is technically allowed, and probably should be moved down to the caveats section. I don't think that we should be allowing blanket disclosure. Part of the reason why this policy exists is to avoid complacency, and this is a great way to ensure it.
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Something I should mention here that's probably not immediately obvious to those outside of lang is that (as we do on the lang calls) I'm generally leaving these comments during a live lang meeting. We might go through 25 items in 150 minutes. That doesn't leave a lot of bandwidth (hence the lang-ops preparation for the calls). That's the context in which I'm asking for a reliable low-cost way to comply with this while being able to leave the comments I need to leave. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I don't think that you need to “pollute” your comments here. I would say, if you're using an LLM to blanket go through all these items, you could easily satisfy this policy by:
Disclosure still counts if it requires clicking on a link.
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
traviscross marked this conversation as resolved.
traviscross marked this conversation as resolved.
jyn514 marked this conversation as resolved.
|
||||||||||||||||||||||||||
| #### ❌ Banned | ||||||||||||||||||||||||||
| The following are banned. | ||||||||||||||||||||||||||
| - Comments from a personal user account that are originally authored by an LLM. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| - ℹ️ This also applies to issue bodies and PR descriptions. | ||||||||||||||||||||||||||
|
traviscross marked this conversation as resolved.
|
||||||||||||||||||||||||||
| - ℹ️ See also "machine-translation" in ⚠️ below. | ||||||||||||||||||||||||||
| - Documentation that is originally authored by an LLM. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| - ℹ️ This includes non-trivial source comments, such as doc-comments or multiple paragraphs of non-doc-comments. | ||||||||||||||||||||||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Reordering this to make it clear first and foremost that "Documentation" includes any doc comments, moving "non-trivial source comments" second. This also drops the quantitative "multiple paragraphs"; some multi-paragraph comments may be trivial, and some one-sentence comments may not be.
Member
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. If you are using an LLM to write a multi-paragraph comment that is trivial, IMO that should also be banned. If you have a load-bearing single-line comment, I think that falls under "code changes authored by an LLM", although I'm not sure how to say that concisely.
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| - ℹ️ This includes compiler diagnostics. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
|
||||||||||||||||||||||||||
| - Code changes that are originally authored by an LLM. | ||||||||||||||||||||||||||
|
jackh726 marked this conversation as resolved.
Outdated
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| - ℹ️ This does not include "trivial" changes that do not meet the [threshold of originality](https://fsfe.org/news/2025/news-20250515-01.en.html), which fall under ⚠️ below. | ||||||||||||||||||||||||||
| - ℹ️ Be cautious about PRs that consist solely of trivial changes. | ||||||||||||||||||||||||||
| See also [the compiler team's typo fix policy](https://rustc-dev-guide.rust-lang.org/contributing.html#writing-documentation:~:text=Please%20notice%20that%20we%20don%E2%80%99t%20accept%20typography%2Fspellcheck%20fixes%20to%20internal%20documentation). | ||||||||||||||||||||||||||
| - See also "learning from an LLM's solution" in ⚠️ below. | ||||||||||||||||||||||||||
| - Treating an LLM review as a sufficient condition to merge or reject a change. | ||||||||||||||||||||||||||
| LLM reviews, if enabled by a team, **must** be advisory-only. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| Teams can have a policy that code can be merged without review, and they can have a policy that code must be reviewed by at least one person, | ||||||||||||||||||||||||||
|
jackh726 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| but they may not have a policy that an LLM review substitutes for a human review. | ||||||||||||||||||||||||||
| - ℹ️ See "review bots" in ⚠️ below. | ||||||||||||||||||||||||||
| - ℹ️ An LLM review does not substitute for self-review. Authors are expected to review their own code before posting and after each change. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| #### ⚠️ Allowed with caveats | ||||||||||||||||||||||||||
| The following are decided on a case-by-case basis. | ||||||||||||||||||||||||||
| In general, new contributors will be scrutinized more heavily than existing contributors, | ||||||||||||||||||||||||||
| since they haven't yet established trust with their reviewers. | ||||||||||||||||||||||||||
|
Comment on lines
+61
to
+62
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
I think it's important to make it clear that this isn't a different set of rules for established project members. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. @alice-i-cecile 👍 for that change as well (with s/yourr/your/), which makes this come across even more diplomatically. I don't think it removes the need to also add the note I added above, but I think it's a great improvement. |
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| - Using an LLM to generate a solution to an issue, learning from its solution, and then rewriting it from scratch in your own style. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
jackh726 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| - Using machine-translation (e.g. Google Translate) from your native language without posting your original message. | ||||||||||||||||||||||||||
| Doing so can introduce new miscommunications that weren't there originally, and prevents someone who speaks the language from providing a better translation. | ||||||||||||||||||||||||||
| - ℹ️ Posting both your original message and the translated version is always ok, but you must still disclose that machine-translation was used. | ||||||||||||||||||||||||||
| - Using an LLM as a "review bot" for PRs. | ||||||||||||||||||||||||||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Maybe I'm OOTL but I find this section situationally strange — where did the "review bot" come from? IME AI-powered review bots that directly participates in PR discussions (esp the "app" ones) are configured by repository owner, but AFAIK r-l/r (which this policy applies solely to) did not have any such bots. I highly doubt a contributor will bring in their own review bot in public. So practically this has to be either
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
I wish it worked like that :( People can just trigger GitHub copilot, or I suppose any other review bot, and let it comment on a r-l/r PR. Some people don't even do it willingly, but GH does it automatically for them, as GH copilot has a tendency to re-enable itself even if you sometimes disable it. It is also not possible to opt-out of the PR author requesting a Copilot review, if I remember correctly. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I’ve seen this behavior elsewhere on GitHub, where contributors effectively use a personal account as a kind of "review bot" to comment on PRs without approval from maintainers.
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Yeah currently disabling review is a personal/license-owner setting, it is not possible to configure from the repository PoV 😞 but I think this is something that we may bring up to GitHub. It may be possible to use content exclusion to blind Copilot, but I'm not sure if this hack is going to produce any overreaching effects (e.g. affecting private IDE usage too).
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
I think this is exactly the point of pointing that out in our policy. Some people trigger a "[at]copilot review" in our repos without asking us for consent. This is rude behaviour and we don't want that. And, yes, as you point out opting out of this "trigger" is currently only a project-wide setting, not at a repository level so we are looking with GitHub if they could make this setting more fine-grained (here on Zulip a discussion with the Infra team) There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. yeah, you're right; I deleted the comment There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Unsolicited review bots are becoming an increasing problem; for example: https://web.archive.org/web/20260426133344/https://github.com/rust-lang/rust-clippy/issues/16893#issuecomment-4321880160 There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Thank you for flagging xtqqczze - the same bot has commented in 6+ issues on the rust-clippy repo and in my case was giving unsolicited advice in a completely derailing direction (solving a specific case I obviously already worked around rather than the general case rust-lang/rust-clippy#16901 (comment))
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. @xtqqczze both rust-lang/rust-clippy#16893 and rust-lang/rust-clippy#16901 are issues not PRs, and that There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I find this review bot policy to be a messy compromise that doens't seem to be serving anyone particularly well. Speaking from general experience, it is rather frustrating as a reviewer to be met with a review request that has then already been answered by an LLM. Even if a maintainer allows the bot, that doesn't necessarily mean that the reviewer consents to it. I think contributors and reviewers who wish to use LLMs for review are better served by running these tools locally, in compliance with the other policies. I propose removing the language around review bots. |
||||||||||||||||||||||||||
| - ℹ️ Review bots **must** have a separate GitHub account that marks them as an LLM. | ||||||||||||||||||||||||||
| You **must not** post (or allow a tool to post) LLM reviews verbatim on your personal account unless clearly quoted with your own personal interpretation of the bot's analysis. | ||||||||||||||||||||||||||
| - ℹ️ Review bot accounts must be blockable by individual users via the standard GitHub user-blocking mechanism. (Note that some GitHub "app" accounts post comments that look like users but cannot be blocked.) | ||||||||||||||||||||||||||
| - ℹ️ Review bots that post without being approved by a maintainer will be banned. | ||||||||||||||||||||||||||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I'm concerned this leaves room for reviewers to trigger a review bot without consent of the author of the PR, which could alienate the PR author. If I opened a PR and it got reviewed by an LLM bot, I would probably close the PR and never try contributing to the project again. I've seen this happen in another project. I think there should be an agreement between the reviewer and PR author before triggering a review bot.
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. "approved by a maintainer" is the key point here, if an LLM review bot is "approved by a maintainer" it means such is a public decision and should be mentioned in CONTRIBUTING.md, and that's the agreement. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. An agreement among maintainers to impose LLM review bots on nonconsenting contributors would drive those contributors away. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. If a reviewer really wants to use an LLM to review, they could run that LLM on their own, filter through the output to determine what is actually relevant and correct, and post in their own words about the identified problems. That doesn't require bothering a nonconsenting PR author with LLM output.
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Rephrasing LLM output is already addressed in lines 67-68. The premise of this whole section is that somehow a bot (as a separate account, line 69) can be officially " If you think that a review bot account should not be allowed, even if approved by maintainers, this whole thread would be more relevant on the parent item (line 66; I've commented about this before). P.S. I don't think this policy implies any LLM review bot account will be allowed "right now" or "soon", I believe there must at least be an FCP. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Thinking about this further, this seems like an overall better process than having a review bot comment on a PR. There's no room for ambiguity about whether a PR author is responsible for responding to LLM output; only the reviewer who decides to use an LLM is in a position to interpret the LLM output because "Comments from a personal user account that are originally authored by an LLM" are explicitly forbidden. |
||||||||||||||||||||||||||
| - ℹ️ If a more reliable tool, such as a linter or formatter, already exists for the language you're writing, we strongly suggest using that tool instead of or in addition to the LLM. | ||||||||||||||||||||||||||
| - ℹ️ Configure LLM review tools to reduce false positives and excessive focus on trivialities, as these are common, exhausting failure modes. | ||||||||||||||||||||||||||
| - ℹ️ LLM comments **must not** be blocking; reviewers must indicate which comments they want addressed. It's ok to require a *response* to each comment but the response can be "the bot's wrong here". | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| - In other words, reviewers must explicitly endorse an LLM comment before blocking a PR. They are responsible for their own analysis of the LLM's comment and cannot treat it as a CI failure. | ||||||||||||||||||||||||||
| - ℹ️ This does not apply to private use of an LLM for reviews; see ✅ above. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| All of these **must** disclose that an LLM was used. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| ## Appendix | ||||||||||||||||||||||||||
| ### Motivation and guiding principles | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| There is not a consensus within the Rust project—and likely never will be—about when/how/where it is acceptable to use AI-based tools. | ||||||||||||||||||||||||||
| Many members of the Rust project and community find value in AI; | ||||||||||||||||||||||||||
| many others feel that its negative impact on society and the climate are severe enough that no use is acceptable. | ||||||||||||||||||||||||||
| Still others are working out their opinion. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| Despite these differences, there are many common goals we all share: | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| - Building a community of deep experts in our collective projects. | ||||||||||||||||||||||||||
| - Building an inclusive community where all feel welcome and respected. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| To achieve those goals, this policy is designed with the following points in mind: | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| - Many people find LLM-generated code and writing deeply unpleasant to read or review. | ||||||||||||||||||||||||||
| - Many people find LLMs to be a significant aid to learning and discovery. | ||||||||||||||||||||||||||
| - LLMs are a new technology, and we are still learning how to use, moderate, and improve them. | ||||||||||||||||||||||||||
| Since we're still learning, we have chosen an intentionally conservative policy that lets us maintain the standard of quality that Rust is known for. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| ### Moderation policy | ||||||||||||||||||||||||||
| #### It's not your job to play detective | ||||||||||||||||||||||||||
| ["The optimal amount of fraud is not zero"](https://www.bitsaboutmoney.com/archive/optimal-amount-of-fraud/). | ||||||||||||||||||||||||||
| Don't try to be the police for whether someone has used an LLM. | ||||||||||||||||||||||||||
| If it's clear they've broken the rules, point them to this policy; if it's borderline, report it to the mods and move on. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| #### Be honest | ||||||||||||||||||||||||||
| Conversely, lying about whether or how you've used an LLM is considered a [code of conduct](https://rust-lang.org/policies/code-of-conduct/) violation. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| If you are not sure where something you would like to do falls in this policy, please talk to the [moderation team](mailto:rust-mods@rust-lang.org). | ||||||||||||||||||||||||||
| Don't try to hide it. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| #### Penalties | ||||||||||||||||||||||||||
| The policies marked with a 🔨 follow the same guidelines as the code of conduct: | ||||||||||||||||||||||||||
| Violations will first result in a warning, and repeated violations may result in a ban. | ||||||||||||||||||||||||||
| - 🔨 Violations of the "Be honest" section | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| Other violations are left up to the discretion of reviewers and moderators. | ||||||||||||||||||||||||||
| For most first-time violations we recommend closing and locking the PR or issue. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| Using an LLM does **not** mean it's ok to harrass a contributor. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| All contributors must be treated with respect. | ||||||||||||||||||||||||||
| The code-of-conduct applies to *all* conversations in the Rust project. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| ### Responsibility | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| Your contributions are your responsibility; you cannot place any blame on an LLM. | ||||||||||||||||||||||||||
| - ℹ️ This includes when asking people to address review comments originally authored by an LLM. See "review bots" under ⚠️ above. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| ### The meaning of "originally authored" | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| This document uses the phrase "originally authored" to mean "text that was generated by an LLM (and then possibly edited by a human)". | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
| No amount of editing can change authorship; authorship sets the initial style and it is very hard to change once it's set. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Taking a different approach here, of narrowing the focus to the phrasing in this policy, rather than trying to get people to agree with the fully general statement. |
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| For more background about analogous reasoning, see ["What Colour are your bits?"](https://ansuz.sooke.bc.ca/entry/23) | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| ### Non-exhaustive policy | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| This policy does not aim to be exhaustive. | ||||||||||||||||||||||||||
| If you have a use of LLMs in mind that isn't on this list, judge it in the spirit of this overview: | ||||||||||||||||||||||||||
| - Usages that do not use LLMs for creation and do not show LLM output to another human are likely allowed ✅ | ||||||||||||||||||||||||||
| - Usages that use LLMs for creation or show LLM output to another human are likely banned ❌ | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
jyn514 marked this conversation as resolved.
Outdated
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| ### Conditions for modification or dissolution | ||||||||||||||||||||||||||
| This policy is not set in stone, and we can evolve it as we gain more experience working with LLMs. | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| Minor changes, such as typo fixes, only require a normal PR approval. | ||||||||||||||||||||||||||
| Major changes, such as adding a new rule or cancelling an existing rule, require | ||||||||||||||||||||||||||
| a simple majority of members of teams using rust-lang/rust (without concerns). | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
Outdated
|
||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| This policy can be dissolved in a few ways: | ||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||
| - An accepted FCP by teams using rust-lang/rust. | ||||||||||||||||||||||||||
|
Comment on lines
+218
to
+223
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Something like this might help in being more clear about which teams need to be involved in these later actions. |
||||||||||||||||||||||||||
| - An objective concern raised about active harm the policy is having on the reputation of Rust, with evidence, as decided by a leadership council FCP. | ||||||||||||||||||||||||||
|
jyn514 marked this conversation as resolved.
|
||||||||||||||||||||||||||
Uh oh!
There was an error while loading. Please reload this page.