Invalid transaction validity: InvalidTransaction::Stale

I have a total plot of ~ 8.5 TB on two HDDs and when setting the --disk-concurrency 4 parameter, the following errors appear:

2022-10-28 20:13:04 [PrimaryChain] 🚜 Claimed block at slot 1666987984                                                              
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] ✨ Imported #88146 (0x9414…bd46)                                                                 
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984                                                                
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] ♻️  Reorg on #88146,0x9414…bd46 to #88146,0x64a1…21e0, common ancestor #88145,0x1050…cd69
2022-10-28 20:13:04 [PrimaryChain] ✨ Imported #88146 (0x64a1…21e0)
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984                                                                
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984                                                                
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984                                                                
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984                                                                
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984
2022-10-28 20:13:04 [PrimaryChain] 🗳️ Claimed vote at slot 1666987984                                                                
2022-10-28 20:13:04 [PrimaryChain] 🙌 Starting consensus session on top of parent 0x105055336a1a52a2c1d266b42ccbe58486baa8406b876be0a8d87a3c4f16cd69                                                                                                                    
2022-10-28 20:13:04 [PrimaryChain] ⌛️ Discarding proposal for slot 1666987984; block production took too long
2022-10-28 20:13:04 [PrimaryChain] 🎁 Prepared block for proposing at 88146 (118 ms) [hash: 0xf6a5f3e371a6dae3bed3c607d760b9115041b8f5077ca1b41349f71685cd5263; parent_hash: 0x1050…cd69; extrinsics (22): [0xf2b9…f219, 0x90d0…800e, 0x1901…f15e, 0xad64…71d0, 0x7c54…d821, 0xd13b…25af, 0x05cd…0360, 0x2371…1c2c, 0xed77…0011, 0xeb46…1db6, 0x594c…375f, 0x906a…c3f0, 0x5ec3…732b, 0x3e53…62ce, 0xad79…f719, 0x9476…4be3, 0xc2c7…cfc6, 0x5aba…2514, 0x0ea3…3a52, 0x3e8d…0969, 0x8bb1…5f9c, 0xdb2d…0b1e]]
2022-10-28 20:13:05 [PrimaryChain] 🚜 Claimed block at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] ✨ Imported #88147 (0x1157…b362)
2022-10-28 20:13:05 [PrimaryChain] ♻️  Reorg on #88147,0x1157…b362 to #88147,0xc0f4…6ab6, common ancestor #88146,0x64a1…21e0
2022-10-28 20:13:05 [PrimaryChain] ✨ Imported #88147 (0xc0f4…6ab6)
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:05 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:06 [PrimaryChain] ✨ Imported #88148 (0x6041…8a20)
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987985
2022-10-28 20:13:06 [PrimaryChain] 🙌 Starting consensus session on top of parent 0x64a148673ed1ca183a0f196ec52995f9ab16731b536f61e8d169071616f521e0
2022-10-28 20:13:06 [PrimaryChain] ⌛️ Discarding proposal for slot 1666987985; block production took too long
2022-10-28 20:13:06 [PrimaryChain] 🎁 Prepared block for proposing at 88147 (0 ms) [hash: 0x4fa5da2e998090a9dec3bd586787e4cf260c1f4bd4d833884d09a57e67b7cb1f; parent_hash: 0x64a1…21e0; extrinsics (1): [0x4533…d7ea]]
2022-10-28 20:13:06 [PrimaryChain] 🚜 Claimed block at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] ✨ Imported #88148 (0x4614…5dce)
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🗳️ Claimed vote at slot 1666987986
2022-10-28 20:13:06 [PrimaryChain] (offchain call) Error submitting a transaction to the pool: Transaction pool error: Invalid transaction validity: InvalidTransaction::Stale
2022-10-28 20:13:06 [PrimaryChain] Error submitting Subspace vote
2022-10-28 20:13:06 [PrimaryChain] 🙌 Starting consensus session on top of parent 0x60415a8736b028d530dde7fcf0811adcfe6ba68ee8d1a100c640289bb3878a20
2022-10-28 20:13:06 [PrimaryChain] 🎁 Prepared block for proposing at 88149 (0 ms) [hash: 0x2b4ed7081b43c0c1029234f6301e033718b06230278c57fbe02287e79531b3cf; parent_hash: 0x6041…8a20; extrinsics (1): [0x5196…38fd]]
2022-10-28 20:13:06 [PrimaryChain] 🔖 Pre-sealed block for proposal at 88149. Hash now 0x407d3f2360627cb3be13504f8d68cfba92edba0c6ad281ad465d2a7938a48096, previously 0x2b4ed7081b43c0c1029234f6301e033718b06230278c57fbe02287e79531b3cf.
2022-10-28 20:13:06 [PrimaryChain] Error with block built on 0x60415a8736b028d530dde7fcf0811adcfe6ba68ee8d1a100c640289bb3878a20: Import failed: Slot number must increase: parent slot: 1666987986, this slot: 1666987986

They disappear when using --disk-concurrency 1.
Chain spec:
https://codeberg.org/Cepera_Leshii/subspace-testnet-3000/raw/branch/main/chain-spec-raw-amaranth.json
Version: b63028b4d03f80e8e4c5c17dcc2221be0e185b00

Block production is too slow, you likely have a lot of space, so a lot of votes are included, too many votes are produced. I think with lower concurrency this is not prevented, but rather delayed instead.

The solution is to adjust initial solution range according to the amount of space pledged by the first farmer or disable solution range adjustment until you know the amount of space pledged.

Proper fix, of course, is to bench voting performance and set corresponding weights on chain.

2 Likes