How to use Erigon snapshot correctly ? #253
Comments
|
|
|
@0x1un This size makes sense |
gm, did you get it resolved? my erigon also was trying to download all snapshots via torrents. my mdbx.dat is also at around 5.5T and i dont think mine was corrupted. |
I did not solve the problem, and I gave up using erigon in favor of geth-bsc. |
i think i figured it out! i used the arg now it's syncing blocks from 7 days ago, so seems to be working |
Thank you for your help. I will decompress the package and try your method again later. |
i might have bad news - the node finished syncing to head overnight, but it seems that this is not an archive node or my method of bootstrapping from that snapshot was incorrect, since i can't query traces from before about 10 days ago or transactions from a little further back 😭 cc @calmbeing, hopefully u have more ideas, thanks in advance! :) |
I seem to only be able to get data after 22,800,000. still using curl --location --request POST '127.0.0.1:8545' \
--header 'Content-Type: application/json' \
--data-raw '{
"jsonrpc": "2.0",
"method": "debug_traceBlockByNumber",
"params": [
"0x15be680",
{"tracer": "callTracer", "timeout": "200s"}
],
"id": 1
}'Here is the current log of my node: Here is the current startup config of my node: apiVersion: apps/v1
kind: StatefulSet
metadata:
name: erigon-bsc-archive-1
namespace: fullnode
labels:
app: erigon-bsc-archive-1
component: core
spec:
serviceName: "erigon-bsc-archive-1"
replicas: 1
selector:
matchLabels:
app: erigon-bsc-archive-1
component: core
template:
metadata:
labels:
app: erigon-bsc-archive-1
component: core
spec:
terminationGracePeriodSeconds: 600
affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: kubernetes.io/hostname
operator: In
values:
- "worker-04-192.168.224.75"
topologyKey: "kubernetes.io/hostname"
priorityClassName: system-cluster-critical
hostNetwork: false
dnsPolicy: ClusterFirstWithHostNet
initContainers:
- args:
- -c
- mkdir -p /data && chown -R 1000:1000 /data
command:
- /bin/sh
image: harbor.local/ops/centos:latest
imagePullPolicy: IfNotPresent
name: init
securityContext:
privileged: true
volumeMounts:
- mountPath: /data
name: erigon-bsc-archive-data-1
imagePullSecrets:
- name: harbor-auth
containers:
- name: erigon
image: harbor.local/da/erigon-bsc:v1.1.0 # node-real bsc-erigon https://github.com/node-real/bsc-erigon
args:
- "--chain=bsc"
- "--http"
- "--http.api=eth,debug,net,trace,web3,erigon"
- "--private.api.addr=0.0.0.0:9090"
- "--http.port=8545"
- "--http.addr=0.0.0.0"
- "--txpool.disable"
- "--db.pagesize=16k"
- "--datadir=/data"
- "--sentry.drop-useless-peers"
- "--p2p.protocol=66"
- "--no-downloader"
ports:
- name: api
containerPort: 9090
- name: rpc
containerPort: 8545
volumeMounts:
- name: erigon-bsc-archive-data-1
mountPath: /data
volumeClaimTemplates:
- metadata:
name: erigon-bsc-archive-data-1
spec:
accessModes: ["ReadWriteOnce"]
storageClassName: erigon-bsc-archive-pv-1
resources:
requests:
storage: 4000Gi |
same rpc method. also not working for the i asked around in the erigon discord tho and was informed that the "snapshots" directory should not be ignored, since they are actually not the "snapshots" in the backup snapshots sense, but are external immutable databases where a lot of the data erigon needs for the historical stuff is stored i restarted a sync, this time using all default settings aka start up with torrenting, then i exited the node and copypasta'ed the 5.5 TB mdbx.db into the data dir after the 1st stage (snapshots stage) was completed now it's still syncing but it went through stage 7 (execution) very quickly, and i haven't seen any errors yet, so likely this is the right way to sync it |
|
@0x1un i got it! the ppl in the erigon discord were very helpful after trying so many times, my node finally started working and i believe this is the best workflow to sync a bsc erigon node so far:
hope its helpful! spent several days on this lol |
|
Thank you very much for your response. I will proceed with the approach you suggested, but I must mention that my internet connection is extremely poor, so it may take a significant amount of time. Once I have completed the process, whether successful or not, I will provide an update here. |
|
The problem is solved, as @0xStrobe says |
erigon-0410.tar.lz4snapshot and decompress then;Why does it still download snaphosts ? Below is my log:
K8S deploy yaml:
Thank you~
The text was updated successfully, but these errors were encountered: