Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Numerous instances of unindexed packs #1229

Open
Kreeblah opened this issue Sep 7, 2024 · 6 comments
Open

Numerous instances of unindexed packs #1229

Kreeblah opened this issue Sep 7, 2024 · 6 comments
Labels
C-question Category: Further information is requested

Comments

@Kreeblah
Copy link

Kreeblah commented Sep 7, 2024

I'm using rustic 0.8.0 on both FreeBSD 14 and macOS 14, and in both cases, I'm seeing a number of things like this show up:

[WARN] pack d4f30393 not referenced in index. Can be a parallel backup job. To repair: 'rustic repair index'.

The thing is, running a prune or a repair index doesn't seem to fix those warnings. However, running restic check on the same repo doesn't report the unindexed packs that rustic check does. Instead, it reports a clean repository.

Is there something I'm doing wrong here? This is using Wasabi S3 for a backend.

@github-actions github-actions bot added the S-triage Status: Waiting for a maintainer to triage this issue/PR label Sep 7, 2024
@KamikazeePL
Copy link

Run restic repair index it should fix it

@Kreeblah
Copy link
Author

So, that's the weird thing. Although restic repair index does find indexes to remove, I get the same warnings from rustic check after having it remove the extra indexes. restic check still reports things as being fine, though.

@simonsan simonsan added C-question Category: Further information is requested and removed S-triage Status: Waiting for a maintainer to triage this issue/PR labels Sep 18, 2024
@simonsan
Copy link
Contributor

Any updates on this? Did you fix it or is the issue still persisting?

@Kreeblah
Copy link
Author

No, I haven't been able to figure out what's going on. Even after running restic repair index, I'm still seeing the same warnings with rustic check, whereas restic check reports no issues.

@aawsome
Copy link
Member

aawsome commented Sep 18, 2024

@Kreeblah can you please post the output of rustic repoinfo? I'd like to find a good strategy how to manually debug what's going on..

@Kreeblah
Copy link
Author

Sure. Here you go:

[INFO] using config /Users/myuser/Library/Application Support/rustic/rustic.toml
[00:00:03] scanning files...                                                    [INFO] repository opendal:bucketname#opendal:bucketname: password is correct.
[INFO] using cache at /Users/myuser/Library/Caches/rustic/2b531df565410f7772e1fd9450cab4b09aef746218035d588be9f531c9d2622e
[00:00:00] scanning index...              ████████████████████████████████████████         29/29        repository files

| File type | Count | Total Size |
|-----------|-------|------------|
| Key       |     1 |      363 B |
| Snapshot  |     2 |    1.1 kiB |
| Index     |    29 |   65.2 MiB |
| Pack      |  9079 |  403.9 GiB |
| Total     |  9111 |  404.0 GiB |

hot repository files

| File type | Count | Total Size |
|-----------|-------|------------|
| Key       |     1 |      363 B |
| Snapshot  |     2 |    1.1 kiB |
| Index     |    29 |   65.2 MiB |
| Pack      |  9079 |  403.9 GiB |
| Total     |  9111 |  404.0 GiB |


| Blob type |   Count | Total Size | Total Size in Packs |
|-----------|---------|------------|---------------------|
| Tree      |  134841 |    2.3 GiB |             1.0 GiB |
| Data      | 1267394 |  489.4 GiB |           402.9 GiB |
| Total     | 1402235 |  491.7 GiB |           403.9 GiB |

| Blob type  | Pack Count | Minimum Size | Maximum Size |
|------------|------------|--------------|--------------|
| Tree packs |         43 |      5.4 kiB |    468.0 MiB |
| Data packs |       9036 |      3.3 MiB |     58.6 MiB |

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-question Category: Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants