docs/plan/ldls.md milestone L0. ldls/ko.c indexes the sections of an ELF64
relocatable object, places the allocatable ones, resolves undefined symbols
against a caller's table and applies the relocations. Nothing is executed.
It is freestanding -- no libc, no allocation, no I/O -- so the same source
builds as a host tool now and as the SchOS-side host later. That is the
arrangement mkschfs and the kernel already share, and for the same reason:
the failures at this layer are format failures, and one found on the host
costs a second instead of a boot.
$ ldls-inspect 8139too.ko
module 8139too
license GPL
loads to 33988 bytes
relocations: 1980
R_X86_64_64 363, PC32 991, PLT32 428, 32S 169, PC64 29
undefined symbols: 94
stops at: unresolved: __fentry__
The licence is printed before anything is loaded, because it is the one
property that decides whether the object may be on the machine at all and it
is a plain string in .modinfo. Rule 1 is easier to keep when the answer is on
screen.
94 symbols is the measured API surface of 8139too on 6.18.46 -- the list,
exactly, rather than an estimate -- and it is L1's work queue. It is smaller
than it looks: __fentry__, __stack_chk_fail, __ref_stack_chk_guard,
__x86_return_thunk and __fortify_panic are compiler and instrumentation
artefacts that stub out in a line each.
Swept over every module in a stock 6.18.46 tree: 2,440 objects, all of them
laid out and relocated to completion, none with a relocation type the loader
does not handle. That sweep is also what retired the fixed section table --
nvidia-modeset has 7,069 sections and 74,305 relocations, against a median of
50 -- so the caller supplies the table and there is no limit to run into
rather than a generous one that fails later.
Loading is not running, and the doc says so: not one symbol is implemented,
and the distance between "relocates" and "transmits a packet" is the rest of
the plan.
No .ko is in this tree and .gitignore now refuses one outright. make
ldls-check runs 18 checks against ldls/test/refmod.c, which is ours, written
to contain one of each thing the loader has to get right.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01VQ7Qx8E1q1M1bbCq8QLHS2
285 lines
14 KiB
Markdown
285 lines
14 KiB
Markdown
# LDLS — the Linux Driver Layer for SchOS
|
|
|
|
SchOS cannot write a driver for every device that exists. No project can. The
|
|
only route to the hardware support an established system has is to run someone
|
|
else's drivers, and in practice "someone else's drivers" means Linux's.
|
|
|
|
[hybrid.md](hybrid.md) built the mechanisms for this and said so in as many
|
|
words — MMIO, DMA, interrupts and config space to a process, with SchOS's own
|
|
drivers as the first consumers so the interface would be general rather than a
|
|
hole shaped like something foreign. `vgpud` proved it. **LDLS is what those
|
|
mechanisms were built for.**
|
|
|
|
---
|
|
|
|
## The rules
|
|
|
|
These are the spine. Everything below is an implementation of them, and
|
|
anything that violates one is wrong however well it works.
|
|
|
|
### 1. Nothing GPL ever enters an image we build
|
|
|
|
The driver is **the user's**, obtained by them, loaded on their machine. SchOS
|
|
ships the layer and never the thing it loads. This is not a new position — it
|
|
was decided on 2026-08-08 and is written up in
|
|
[../architecture/devices.md](../architecture/devices.md) and
|
|
[../licensing.md](../licensing.md) §2:
|
|
|
|
> Apache-2.0 code and GPL-2.0-only code cannot be combined into one
|
|
> distributable work. It is not a matter of taste or of how carefully the files
|
|
> are kept apart in the tree.
|
|
|
|
`RAMDISK_EXCLUDE` and `NOTPORTS` are the existing mechanisms that keep this
|
|
true mechanically rather than by intention, and LDLS must stay inside them.
|
|
|
|
### 2. It runs in a process, never in the kernel
|
|
|
|
Two independent reasons, and either alone would decide it.
|
|
|
|
**Legally**, a module linked into our kernel is the strongest derivative-work
|
|
argument that exists — it is the case the FSF has always made. A module
|
|
combined with our shim *inside a user process, on the user's machine, at their
|
|
direction* is a different thing at arm's length, and it is the position
|
|
FreeBSD has shipped from for about a decade: a BSD-licensed `linuxkpi` in base,
|
|
GPL `drm-kmod` installed by the user from ports.
|
|
|
|
**Practically**, this is foreign code. A driver we did not write, cannot fully
|
|
audit and did not choose the quality of, running with the machine's memory in
|
|
reach, is exactly the code that should not be able to take the machine down.
|
|
Crash isolation is not a nicety here; it is the reason.
|
|
|
|
### 3. Facts, not expression
|
|
|
|
The shim has to present Linux's internal API, and that API is expressed in GPL
|
|
headers. The line LDLS holds:
|
|
|
|
| | |
|
|
|---|---|
|
|
| A symbol exists, and takes these arguments | **fact** — reproduce it |
|
|
| A struct has these fields in this order at these offsets | **fact** — a compiled driver indexes them, so there is no other way to express it |
|
|
| The comment above it | **expression** — never |
|
|
| The macro body, the inline function body, the implementation | **expression** — never |
|
|
|
|
Every KPI file records where its shape came from. Not decoration: it is the
|
|
difference between a clean-room reimplementation and a transcription, and the
|
|
only time anyone will ask is the time it matters.
|
|
|
|
This is the same discipline [../licensing.md](../licensing.md) §5 already
|
|
describes — *"the xHCI, USB, PCI, fbdev and ELF specifications were all read
|
|
and implemented directly, which is why those drivers have no licence
|
|
entanglement at all"* — applied to a case where the specification is thinner.
|
|
|
|
> **Not legal advice, and it should be checked by someone whose job that is
|
|
> before anything ships.** The reasoning rests on interfaces being outside
|
|
> copyright (EU Software Directive Art. 1(2)) and on *Google v. Oracle* (2021),
|
|
> and neither is a blanket permission.
|
|
|
|
### 4. One kernel version at a time, pinned and named
|
|
|
|
Linux states in writing that it has no stable in-kernel ABI —
|
|
`Documentation/process/stable-api-nonsense.rst` exists to say so. Believing
|
|
them is cheaper than being surprised by them.
|
|
|
|
So LDLS targets **one version**, says which, and is re-pinned deliberately.
|
|
FreeBSD's LinuxKPI does exactly this per drm-kmod release. A layer that claims
|
|
to support "Linux drivers" without a version is claiming something nobody has
|
|
ever delivered.
|
|
|
|
### 5. The unresolved-symbol list is the specification
|
|
|
|
Do not guess the API surface. **Load a real module and let the loader say what
|
|
is missing.** That list is the work queue, it is exact, and it is available
|
|
before a single line of shim is written.
|
|
|
|
---
|
|
|
|
## What it is made of
|
|
|
|
Four pieces, of which three are ordinary and one is the project.
|
|
|
|
### The loader — ours, clean, and small
|
|
|
|
A `.ko` is a relocatable ELF64 object. Loading one is: lay out the allocatable
|
|
sections, apply the relocations, resolve the undefined symbols against a table,
|
|
and find the entry point. SchOS already parses ELF in `kernel/fs/exec.c`, for a
|
|
different object type but with the same plumbing.
|
|
|
|
There is no licence question here at all — ELF is a published specification and
|
|
so is the relocation set.
|
|
|
|
### The KPI — the shim, and the actual work
|
|
|
|
Our Apache-2.0 reimplementation of the Linux symbols a given driver needs,
|
|
organised under Linux's own header names so it is navigable: `kpi/slab.h`,
|
|
`kpi/pci.h`, `kpi/netdevice.h`. Rule 3 governs every file.
|
|
|
|
### The back end — already built
|
|
|
|
`/dev/pci`: `PCIIOC_INFO`, `PCIIOC_CLAIM`, `PCIIOC_CFG`, `mmap` of a BAR,
|
|
`PCIIOC_DMA`, `PCIIOC_IRQ`. A Linux driver's `pci_iomap`, `dma_alloc_coherent`
|
|
and `request_irq` land on these, which is the whole reason they were specified
|
|
in terms of PCI devices rather than in terms of drivers.
|
|
|
|
### The class bridge — the one new kernel interface
|
|
|
|
This is the piece that does not exist, and it is the interesting one.
|
|
|
|
A hosted driver produces packets in a process. SchOS's network stack consumes
|
|
them through `struct netdev_ops` in the kernel — `transmit`, `receive`, `mac`,
|
|
`link_up`, four entries and nothing else. So what is missing is a **netdev
|
|
whose backend is a process**: the kernel publishes the vtable, the four calls
|
|
are forwarded over a descriptor, and lwIP never learns that the driver is not
|
|
in the kernel.
|
|
|
|
It is the exact analogue of what `display_ops` was for the GPU, and
|
|
`netdev.h`'s own opening comment already anticipates the shape — *"the stack
|
|
should ask for the network interfaces and get whatever is bound … exactly as a
|
|
compositor asks for the display and does not care which driver answers."*
|
|
|
|
One device, one process, claimed and released, on the `/dev/pci` discipline.
|
|
|
|
---
|
|
|
|
## Milestones
|
|
|
|
| | | |
|
|
|---|---|---|
|
|
| **L0** | **The loader.** Parse a real `.ko`, lay it out, relocate it, and **print every unresolved symbol**. Nothing executes. The output is the measured API surface. | **done** — `ldls/ko.c`, `make ldls-check` |
|
|
| **L1** | **Stubs.** Every symbol resolves, to a function that logs its name and stops. `init_module` runs and dies at the first real call — which yields the *call order*, the second thing you need and the other thing you cannot guess. | |
|
|
| **L2** | **The hardware.** `probe()` receives a working `struct pci_dev`, maps its BARs, allocates coherent DMA and registers an interrupt, all through `/dev/pci`. The driver reaches its device. | |
|
|
| **L3** | **A packet.** The process-backed netdev, wired to the driver's transmit and receive paths. **`ping` over a Linux driver.** This is the milestone that proves the whole idea and the one that cannot be skipped. | |
|
|
| **L4** | **Kill it.** The host process dies, the kernel clears bus mastering and reclaims the DMA, a new host starts and the interface comes back. | free — H2 built all of this |
|
|
|
|
L4 is listed for completeness rather than as work. `pciuser_stop()`,
|
|
`pciuser_release_all()` and `KeepAlive` already do it, and that they apply
|
|
unchanged to a foreign driver is the point of having built them against our
|
|
own.
|
|
|
|
### The first target: `8139too`, not `r8169`
|
|
|
|
The obvious choice is a Realtek `r8169`, because that silicon is everywhere.
|
|
It is the wrong first choice for one decisive reason: **QEMU cannot emulate
|
|
it**, so L0 through L3 would have no way to be tested, and a driver layer
|
|
developed against hardware you cannot run is a layer nobody can debug.
|
|
|
|
QEMU emulates `rtl8139`. `8139too` is small, self-contained, needs no firmware
|
|
blob, and uses the thin `mii` helpers rather than dragging in phylib — which
|
|
`r8169` does, and which is a substantial surface on its own.
|
|
|
|
So: **`8139too` to build the layer, `r8169` to prove it was general.** The
|
|
second is the interesting one and it is much cheaper once the first works.
|
|
|
|
This is the `/dev/pci` lesson applied backwards. There, a native driver was the
|
|
first consumer so the interface would not be shaped like something foreign.
|
|
Here the interface is fixed by Linux, and what is chosen instead is the
|
|
*smallest real consumer that can be tested* — because the risk is no longer
|
|
designing the wrong interface, it is building a hundred stubs nobody has ever
|
|
run.
|
|
|
|
---
|
|
|
|
## L0, and what it measured
|
|
|
|
`ldls/ko.c` is the loader: index the sections, place the allocatable ones,
|
|
resolve the undefined symbols against a table, apply the relocations. It is
|
|
freestanding — no libc, no allocation, no I/O — so the same source builds as a
|
|
host tool today and as the SchOS-side host later, which is the arrangement
|
|
`mkschfs` and the kernel already share.
|
|
|
|
```
|
|
$ ldls-inspect 8139too.ko
|
|
119288 bytes, 55 sections, 363 symbols
|
|
module 8139too
|
|
license GPL
|
|
describes RealTek RTL-8139 Fast Ethernet driver
|
|
loads to 33988 bytes
|
|
|
|
relocations: 1980
|
|
R_X86_64_64 363
|
|
R_X86_64_PC32 991
|
|
R_X86_64_PLT32 428
|
|
R_X86_64_32S 169
|
|
R_X86_64_PC64 29
|
|
|
|
undefined symbols: 94
|
|
...
|
|
stops at: unresolved: __fentry__
|
|
```
|
|
|
|
**The licence is printed first, before anything is loaded**, because it is the
|
|
one property that decides whether the object may be on this machine at all and
|
|
it is a plain string in `.modinfo`. Rule 1 is easier to keep when the answer is
|
|
on screen.
|
|
|
|
### What the measurement says
|
|
|
|
**94 symbols** is the API surface of `8139too` on Linux 6.18.46. Not an
|
|
estimate — the list, exactly, and it is L1's work queue. It is also smaller
|
|
than it looks, because a good fraction of it is not API at all: `__fentry__`,
|
|
`__stack_chk_fail`, `__ref_stack_chk_guard`, `__x86_return_thunk` and
|
|
`__fortify_panic` are compiler and instrumentation artefacts that stub out in a
|
|
line each.
|
|
|
|
**Five relocation types**, and a corpus run says that is the whole set: over
|
|
**2,440 real modules** from a stock 6.18.46 tree, every one lays out and
|
|
relocates to completion with nothing unhandled. That includes `nvidia-modeset`
|
|
at 7,069 sections and 74,305 relocations, which is what retired the loader's
|
|
fixed section table — the caller supplies it now, so there is no limit to run
|
|
into rather than a generous one.
|
|
|
|
Relocating against stubs is a separate question from listing what is missing,
|
|
and it is the one that says the loader is finished: with nothing resolved, the
|
|
first unknown name stops everything and no relocation type past it is ever
|
|
reached.
|
|
|
|
### Nothing foreign is in this tree
|
|
|
|
`make ldls-check` runs the loader against `ldls/test/refmod.c` — ours, compiled
|
|
with `-c`, written to contain one of each thing the loader has to get right:
|
|
undefined functions *and* undefined data, `.text` with calls, `.data` holding a
|
|
pointer into `.rodata`, a `.bss` that must arrive zeroed, and a `.modinfo`
|
|
shaped the way a module's is. The modules above were read from the host's own
|
|
`/nix/store` and never copied here; `.gitignore` refuses `*.ko` outright so
|
|
that cannot happen by accident.
|
|
|
|
---
|
|
|
|
## What it will not do
|
|
|
|
- **It is not a security boundary, and here that is worse than usual.** There
|
|
is no IOMMU, so a hosted driver can point its device at any physical address.
|
|
For SchOS's own drivers that isolates bugs and not intent, which
|
|
[hybrid.md](hybrid.md) says at length. For *foreign* drivers the distinction
|
|
between bug and intent is one we are in no position to make at all. This is
|
|
the single strongest argument for an IOMMU that this project has produced,
|
|
and it should be recorded as such rather than waved past.
|
|
- **No answer yet on `EXPORT_SYMBOL_GPL`.** Linux marks much of its internal
|
|
API GPL-only and modules carry `MODULE_LICENSE`. A layer that supplies those
|
|
symbols while asserting a licence it does not hold would be a deliberate
|
|
circumvention, and LDLS must not do that. What it should do instead —
|
|
refuse such modules, or simply not claim to be Linux and let the user decide
|
|
what they load on their own machine — is **undecided**, and is the first
|
|
thing to take real advice on.
|
|
- **No firmware loading.** `request_firmware` is a stub that fails. Many
|
|
drivers need a blob, most blobs are redistributable only under their own
|
|
terms, and that is a second licensing problem which is not this one.
|
|
- **No module-to-module dependencies.** One object, no `depmod`, no symbol
|
|
exports between hosted modules.
|
|
- **No sysfs, procfs or debugfs.** Drivers that only *report* through them will
|
|
work; drivers that are *configured* through them will not.
|
|
- **No unload.** `module_exit` is never called; the way to stop a driver is to
|
|
kill the process, which H2 made a supported operation rather than a failure.
|
|
- **No sleeping-context fidelity.** Linux drivers assume a kernel's rules about
|
|
what may sleep, what runs in interrupt context and what `spin_lock_irqsave`
|
|
costs. A process has different rules, and where they differ the shim will be
|
|
wrong in ways that show up as rare races rather than as failures to build.
|
|
This is the deepest technical risk in the whole plan.
|
|
- **Loading is not running.** L0 proves 2,440 modules can be laid out and
|
|
relocated. That says the *format* is handled and says nothing whatever about
|
|
whether any of them would work: not one symbol is implemented, and the
|
|
distance between "relocates" and "transmits a packet" is the entire rest of
|
|
this plan.
|
|
- **It will not support "Linux drivers".** It will support *one driver, on one
|
|
kernel version, that has been tried*. Anything beyond that is a claim, and
|
|
the list of what has actually been run belongs in the architecture document
|
|
when there is one.
|