fediversity/fediversity

Continuous Integration builds available in a public cache #92

New issue

Open

opened 2025-01-31 11:28:14 +01:00 by fricklerhandwerk · 4 comments

fricklerhandwerk commented

2025-01-31 11:28:14 +01:00

Owner

As a developer,
I want for Continuous Integration builds to be available in a public cache,
so that I may get the code running more easily.

implementation notes

this can be done safely using:

as per #155 (comment), we should have an isolated instance that will run builds on PRs, read-only accessing the main cache and not caching build results (or only between PR rebuilds), and another instance that runs builds on main and caches build results publicly.

**As** a developer, **I want** for Continuous Integration builds to be available in a public cache, **so that** I may get the code running more easily. ### implementation notes this can be done safely using: - [`attic`](https://github.com/zhaofengli/attic) - [`celler`](https://discourse.nixos.org/t/celler-an-attic-fork/77265/6) - [`niks3`](https://github.com/Mic92/niks3) - [snix nar-bridge](https://snix.dev/docs/components/overview/#nar-bridge) - [`nix-cache-beacon`](https://discourse.nixos.org/t/nix-cache-beacon-mdns-discovery-for-nix-binary-caches/77756) - c.f. [mirroring upstream caches](https://discourse.nixos.org/t/announcing-ncps-a-nix-cache-proxy-server-for-faster-builds/58166) as per https://git.fediversity.eu/fediversity/fediversity/issues/155#issuecomment-4229, we should have an isolated instance that will run builds on PRs, read-only accessing the main cache and not caching build results (or only between PR rebuilds), and another instance that runs builds on `main` and caches build results publicly.

Niols commented

2025-01-31 14:16:33 +01:00

Owner

@roberth > Do you have anything set up at least for NixOps4, the version of Nix you rely on, the providers, etc.? A cache somewhere that we could recommend in our README?

@roberth > Do you have anything set up at least for NixOps4, the version of Nix you rely on, the providers, etc.? A cache somewhere that we could recommend in our README?

roberth commented

2025-01-31 14:32:53 +01:00

Owner

I've set up https://nixops4.cachix.org, written to by a Hercules CI agent that I run for the https://github.com/nixops4 org.

It's not a particularly long build, so I haven't bothered documenting the existence of this cache.

I don't think it's particularly relevant to Fediversity either, because a build will end up in the Fediversity cache anyway.

I've set up https://nixops4.cachix.org, written to by a Hercules CI agent that I run for the https://github.com/nixops4 org. It's not a particularly long build, so I haven't bothered documenting the existence of this cache. I don't think it's particularly relevant to Fediversity either, because a build will end up in the Fediversity cache anyway.

Niols commented

2025-01-31 14:35:55 +01:00

Owner

Indeed; but seeing as there is no Fediversity cache for now, that could give us a small gain in the meantime.

Indeed; but seeing as there is no Fediversity cache for now, that could give us a small gain in the meantime.

kiara commented

2025-03-22 09:49:04 +01:00

Owner

c.f. #155

edit: caching notes

c.f. #155 edit: [caching notes](https://codeberg.org/kiara/e2ed-hetzner/issues/8)

kiara added the

label

2025-05-01 11:54:22 +02:00

kiara added a new dependency

2025-05-01 12:12:14 +02:00

#288 external developers empowered to contribute

kiara changed title from ~~Add CI builds to a public cache~~ to Continuous Integration builds available in a public cache

2025-06-01 15:06:25 +02:00

kiara added

type: user story

and removed

labels

2025-06-01 15:06:42 +02:00

kiara referenced this issue

2025-06-02 11:21:58 +02:00

name paths for purity, preventing double-hash store paths #346

kiara referenced this issue

2025-06-05 12:41:21 +02:00

NixOS tests break when CI runs them in parallel #362

kiara referenced this issue

2025-06-10 20:32:13 +02:00

external developers empowered to contribute #288

kiara added this to the Fediversity project

2025-06-19 13:31:40 +02:00

kiara self-assigned this

2025-06-19 13:33:22 +02:00

kiara referenced this issue from a pull request that will close it,

2025-06-19 17:53:44 +02:00

WIP: add attic cache #397

fricklerhandwerk referenced this issue

2025-06-20 12:12:21 +02:00

WIP: add attic cache #397

kiara removed their assignment

2025-06-23 07:27:32 +02:00

kiara referenced this issue

2025-08-05 00:51:58 +02:00

WIP: add woodpecker CI #479

kiara self-assigned this

2025-08-07 15:13:35 +02:00

kiara added

and removed

type: user story

labels

2025-09-19 09:02:27 +02:00

kiara added the

label

2025-12-02 20:04:16 +01:00

kiara added a new dependency

2025-12-02 20:09:04 +01:00

#155 Address CI friction between security and caching

kiara referenced this issue

2026-04-22 18:15:04 +02:00

tests efficiently use RAM #835

kiara referenced this issue

2026-05-01 12:52:12 +02:00

tests efficiently use time #837

kiara referenced this issue

2026-05-07 09:46:30 +02:00

Extract inline python code #832

Toast referenced this issue

2026-05-07 17:02:16 +02:00

Apps panel checks has extremely inefficient disk usage #913

kiara referenced this issue

2026-06-06 14:23:33 +02:00

Address CI friction between security and caching #155

kiara removed a dependency

2026-06-06 14:23:39 +02:00

#155 Address CI friction between security and caching

kiara added a new dependency

2026-06-07 18:19:33 +02:00

#954 demo env broken

kiara referenced this issue from a pull request that will close it,

2026-06-29 20:35:28 +02:00

WIP: dev: public niks3 binary cache (#92) #1148

Sign in to join this conversation.

No labels

application-offering

configure-applications

ambition/install-applications

update-applications

user-management

component: fediversity panel

component: nixops4

estimation high: >3d

estimation low: <2h

estimation mid: <8h

infinite points

project-management

role: application developer

role: application operator

role: hosting provider

role: maintainer

type: deliverable

type: key result

type: objective

type: user story

user experience

No milestone

No project

No assignees

4 participants

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Blocks

#288 external developers empowered to contribute

fediversity/fediversity

Depends on

#954 demo env broken

fediversity/fediversity

Reference

fediversity/fediversity#92

No description provided.