Appending to a file is not idempotent

[coreos]

Appending to a file is not idempotent

[jlebon]

Neat, I didn't know about https://httpbin.org/.

There's a potential optimization we could do on OSTree-based systems for files in /etc: there's already a backup of the shipped file in /usr/etc. Though there are some instance-specific files that don't have such a backup, e.g. /etc/fstab. But we could easily detect those by the fact that they're not in /usr/etc.

I'll just also mention that making append operations idempotent is also relevant for other software that handle Ignition configs like the machine config daemon (though right now it just sorta assumes that it won't be handed a config that asks for appending files).

[ajeddeloh]

@bgilbert The proposed fix would help, but wouldn't completely fix the problem. If something fails during or after deleting the .orig files then we have the same problem.

@jlebon we'd need to bake the logic into ignition to append from /usr/etc to /etc but just on ostree systems. I'm not fanatical about that. I'd rather just redeploy the root if Ignition failed. It also still leaves us with the same problem on /var or any secondary filesystems.

[bgilbert]

The assumption was that nothing would fail after the commit point. The approach isn't bulletproof, but would at least address Ignition config problems and transient network conditions.

I agree that the ostree-specific logic doesn't seem worth it.