I dunno man I don't think building a piece of software that you don't sell and don't force people to use should imply any kind of responsibility

Your responsibility is to your community, not your "users." Nobody is part of my community just because they use a website theme or Rust library I wrote, and I think this applies to fedi software too