Replaces https://github.com/ethereum-optimism/optimism/pull/9089

We do not want to call the `FFIInterface` or other test contracts as part of the
invariant tests because it will create malformed inputs and cause
unrelated invariant tests to fail.

Co-authored-by: Luke <chenqun.l@kaitaitech.cn>

* op-e2e: revive original 4844 DA test
Co-authored-by: Roberto Bayardo <bayardo@alum.mit.edu>

* op-service: fix beacon API HTTP client encoding of query string, avoid malformatting due to path joining

* op-batcher: data-availability-type enum and generic flag

* op-e2e: eip4844 test improvements

* op-batcher,op-service: review fixes on 4844 api fix

* eth: Add tests of Beacon API response structs

* eth,sources,fakebeacon: Update Beacon API BlobSidecar format

* eth: Remove field BlobSidecar.BlockRoot

* eth: Fix BeaconBlockHeader json tag, test APIGetBlobSidecarsResponse

* eth: Simplify Beacon API types and tests

* op-service: fix bytes96 terminal stringer in op-service/eth/types.go

* op-service: fix comment lint

---------
Co-authored-by: Roberto Bayardo <bayardo@alum.mit.edu>
Co-authored-by: Sebastian Stammler <seb@oplabs.co>

Generating the allocs no longer relies on `geth` so we do not need to
install `geth` as part of bringing up the devnet. We also generate the
allocs once and then persist them to the CI workspace. This will save
~1-1.5 minutes per CI run by no longer installing `geth` as part of
the devnet.

* cannon: Allow stopping at first preimage read

* cannon: support stopping on preimage key and type

* contracts-bedrock: flake fix attempt

Progress towards fixing flakes in CI. Using `etch` to set contracts in
state instead of deploying will help to fix the nonce mismatches between
the L1 contract addresses and the L2 genesis that contains L1 contract
addresses.

Developers will need to run `forge clean` to remove artifacts for the
tests to pass after this commit is merged. It enforces a single version
of `FFIInterface` to be compiled instead of it being compiled with
multiple compiler versions. The `vm.getCode` family of cheats fail when
there are multiple compiled versions of the same contract because the
artfact has the compiler version appended to the name of the artifact.

This will also help to improve compiler time since the compiled
contracts do not need to include the compiled bytecode of the deploy and
ffiinterface contracts, the code is loaded dynamically instead of being
deployed with `CREATE`.

* contracts-bedrock: more cleanup

Deletes a dead file that is no longer needed and sets the deploy config
in state using `etch`. `DeployL2` is not used, we should be using the
`superchain-ops` repo for deploying new L2 contracts or deploy them
through L1. Since `DeployL2` used code using solc `0.8.19` (EAS) it
caused multiple versions of the `DeployConfig` to be compiled which
causes headaches when using `vm.getCode`.

* contracts-bedrock: update gas snapshot

* contracts-bedrock: more cleanup

* contracts-bedrock: gas-snapshot

* lint: fix

Introduces the infrastructure for monitoring large pre-image proposals, up to loading the list of in-progress games from the contract.
Actual content of the preimages is not yet loaded or checked.

* op-node: fix parent-beacon-block-root comparison check

* op-node: nit in op-node/rollup/derive/engine_consolidate.go
Co-authored-by: Sebastian Stammler <seb@oplabs.co>

* op-node: two-side nil parent beacon block root test case

---------
Co-authored-by: Sebastian Stammler <seb@oplabs.co>

* contracts-bedrock: hacky patch for CI failures

CI is consistently failing due to the L2 genesis generation happening
out of process using ffi. Ideally the genesis state could be ran a
single time once outside of the process ahead of time but the problem
with this approach is that the deployer nonce is not correct and the
L1 contract addresses in practice end up not matching the addresses
that are injected into the L2 genesis state. There are a few solutions
to this problem, one is deploying the proxies with create2 and another
is to ensure that the deployer does not deploy additional contracts
in the test case setup that are not deployed in the L1 genesis gen
setup so that we are guaranteed that the contracts have the same
addresses.

This is a hacky patch to attempt to fix the issue where it will wait
if the allocs file doesn't exist. Something with the process running in
parallel causes the file to not exist. The downside of this fix is that
CI may hang silently forever if the file is lost for some reason.

Another solution would be to return the JSON to solidity and then write
it to a temp file. This isn't ideal but could work in the short term.
We are working on a rewrite of the L2 genesis generation in solidity
that will fix this issue along with many other devex issues in the
monorepo.

* ctb: update gas snapshot

Bumps [github.com/onsi/gomega](https://github.com/onsi/gomega) from 1.30.0 to 1.31.0.
- [Release notes](https://github.com/onsi/gomega/releases)
- [Changelog](https://github.com/onsi/gomega/blob/master/CHANGELOG.md)
- [Commits](https://github.com/onsi/gomega/compare/v1.30.0...v1.31.0)

---
updated-dependencies:
- dependency-name: github.com/onsi/gomega
  dependency-type: direct:production
  update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* feat(op-challenger): Adds a helper to call the initLPP preimage oracle
contract call.

* fix(op-challenger): call init large preimage from the uploader

* fix(op-challenger): keep large preimage upload unsupported for the interim

Co-authored-by: Roberto Bayardo <bayardo@alum.mit.edu>

* op-node: L2 Dencun implementation updates

init branch

Update reference to Eclipse/Ecotone in specs.

Pull in Danyal's deposit source and add additional tests.

Add notion of ParentBeaconRoot and build a contract deploy tx in attributes.go.

Add a test for activating dencun l2 fork after genesis.

Add draft ecotone setup.

Add first pass of Eclipse upgrade txns

Fix tests/compile

Code review feedback

Obey linter.

Move ecotone setup to helpers.go; get the ParentBeaconBlockRoot from the l1Info in attributes.go.

chore(op-node): Add tests for Ecotone deposit transactions (#8746)

* Source hash teEvanJRichard <evan@oplabs.co>

dencun review fixes

derive: ecotone upgradeTo abi encoding

op-e2e: test L2 exclusion of blob-txs in Ecotone

op-node/rollup: deduplicate ecotone activation helper func, fix rollup config var name

op-chain-ops: clarify 4788 contract nonce

op-node/rollup: add setEcotone to ecotone upgrade txs

dencun review fixes

Dencun: P2P / EngineAPI / ExecutionPayloadEnvelope changes

Includes:
- Pass through execution payload (Envelope type everywhere) by Danyal,
  extended by Proto
- Fix ecotone upgrade txns, by Danyal
- ci fixes by Danyal
- P2P Req/Resp (version based encoding/decoding) by Danyal
- EngineAPI v3 usage by Danyl, rebased by Proto on EngineController (from
  trianglesphere)
- Block v3 Gossip validation, by Danyal
- Block v3 Gossip publishing, by Proto

Rebased on updated Ecotone / Dencun base branch

op-e2e: fix upgrade-txs count in test

op-node: fix l1 info scalar migration, implement dencun review suggestions

op-node: more dencun review nit fixes

op-node: rabbit suggestions, but fixed

Fix nil pointer in p2p sync for Ecotone blocks

dencun: fix more nits

op-e2e: fix lint
Co-authored-by: Danyal Prout <me@dany.al>
Co-authored-by: protolambda <proto@protolambda.com>
Co-authored-by: EvanJRichard <evan@oplabs.co>

* Add tests for attribute matching

* Provide a no-op blob fetcher to prevent derivation error

Fail tests when there is an unknown error

Fix typo / empty array to nil

Update L2 tests to ecotone / add additional checks

* op-e2e: dencun action-test setup fixes

* op-node: op-conductor dencun todo

* dencun: fix review nit about parent beacon block root gossip check style

---------
Co-authored-by: Danyal Prout <me@dany.al>
Co-authored-by: protolambda <proto@protolambda.com>

* op-chain-ops,op-node: ecotone upgrade txs, fix l1-fee scalar migration
Co-authored-by: Danyal Prout <me@dany.al>
Co-authored-by: protolambda <proto@protolambda.com>
Co-authored-by: EvanJRichard <evan@oplabs.co>

* op-chain-ops: execute ecotone upgrade txs on L2 genesis generation

* op-e2e: update fees test to cover regolith and ecotone fees incl. strict GPO comparison

* op-chain-ops: add StateDB interface assertion

* ecotone-upgrade: implement version naming review suggestion

* op-node: clean up system config scalars parsing, add unit tests

* op-service: fix version name

* op-node: improve L1info to sys-config reverse translation step

* op-node: fix sys-config ecotone scalars getter refactor bug

---------
Co-authored-by: Danyal Prout <me@dany.al>
Co-authored-by: EvanJRichard <evan@oplabs.co>

* Large preimage proposals spec

* toc

Bumps [supertest](https://github.com/ladjs/supertest) from 6.3.3 to 6.3.4.
- [Release notes](https://github.com/ladjs/supertest/releases)
- [Commits](https://github.com/ladjs/supertest/compare/v6.3.3...v6.3.4)

---
updated-dependencies:
- dependency-name: supertest
  dependency-type: direct:development
  update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* contracts-bedrock: modularize deployer script

Move logic for interacting with artifacts outside
of the deployer contract into its own contract.

This allows for other contracts to easily inherit the
contract so that any contract can read in contract
addresses.

* ctb: handle devnet

* contracts-bedrock: fixup

* lint: fix

Bumps [eslint-plugin-unicorn](https://github.com/sindresorhus/eslint-plugin-unicorn) from 49.0.0 to 50.0.1.
- [Release notes](https://github.com/sindresorhus/eslint-plugin-unicorn/releases)
- [Commits](https://github.com/sindresorhus/eslint-plugin-unicorn/compare/v49.0.0...v50.0.1)

---
updated-dependencies:
- dependency-name: eslint-plugin-unicorn
  dependency-type: direct:development
  update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* op-chain-ops: create op-version-check

forked from op-upgrade

* op-version-check: drop logic for upgrading contracts

* op-version-check: add logic for outputting contract versions

* op-version-check: improve support for checking multiple chains

* op-version-check: replace legacy upgrade references

* op-chain-ops: create README

* op-version-check: improve README

* op-version-check: drop unnecessary deploy-config flag

* op-version-check: create op-version-check in Makefile

* op-version-check: add usage section to README

* op-chain-ops: add op-version-check to README

* op-version-check: fix path in README

* op-version-check: remove unused function toDeployConfigName

* op-version-check: drop capitalization on error strings

* op-node: capitalize writeJSONFile function

this makes it accessible when op-node/cmd/genesis is imported as a package

* op-chain-ops: use op-node/cmd/genesis for writeJSON

* op-chain-ops: set name op_node_genesis for import

* op-chain-ops: use op-node WriteJSONFile in op-upgrade

* op-chains-ops: move to toSuperchainName to upgrades package

* op-chain-ops: output all contracts for op-version-check

addresses https://github.com/ethereum-optimism/optimism/pull/8859#issuecomment-1881663953

* op-chain-ops: add logging if chain ID is skipped by op-version-check

* op-service: create jsonutil/write

* op-chain-ops use jsonutil in op-upgrade, op-version-check

* op-chain-ops: pass RPC URLs as flags in op-version-check

* op-chain-ops: refactor of op-version-check

* op-chain-ops: refactor of op-version-check

* op-chain-ops: add more logging for op-version-check

* op-chain-ops: add more logging for op-version-check

* Add minimum proposal size + configuration

* @inphi review

The foundry install script uses `jq` so we must install `jq` as early
as possible in `ci-builder` to ensure that its always present.

Follow up to https://github.com/ethereum-optimism/optimism/pull/9042
which fixes the broken build from https://github.com/ethereum-optimism/optimism/pull/8920.

I don't think that #8920 broke the fix in this commit so perhaps the
build was broken longer than we thought? Either way, we need new forge
version in CI that was introduced in https://github.com/ethereum-optimism/optimism/pull/9038
so we need a successful build of `ci-builder`.

* contracts-bedrock: bump forge-std 1fd874f0efdb711cb6807c4f4a000ed2805dc809

Bumps `forge-std` to the latest commit that includes the `vm.dumpState`
cheatcode.

- https://github.com/foundry-rs/forge-std/pull/499
- https://github.com/foundry-rs/foundry/pull/6827

* contracts-bedrock: fix build

* feat(op-challenger): large preimage uploader

* feat(op-challenger): split preimage wiring

Was broken with https://github.com/ethereum-optimism/optimism/pull/8920
due to the new `jq` dependency not being present in the builder image.
Fix by installing `jq` in the builder image.

with this missing, the raw markdown without any link is rendered -> ugly/confusing

* Fix `PreimageOracle` off-by-one bug

* fix mips oracle bin

Updates the getting-started tutorial config file with the latest changes
on develop.

Updates foundry to the commit `9e2830d7f0566e0d00b1104eeaedd5032a4e556e`.
Includes the `vm.dumpState` cheatcode implemented in https://github.com/foundry-rs/foundry/pull/6827.
This will unblock the migration of the genesis generation to solidity to
improve the devex of the L2 contracts and allow us to delete a lot of
custom Go code as well as reduce flakes in CI due to not being able to
find the `genesis.json`.