Skip to content

v0.9.0
Compare
Choose a tag to compare
@wader wader released this 25 Nov 17:53
· 503 commits to master since this release
v0.9.0
1482145
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Changes

  • Make synthetic values not look like decode values with a zero range. #777
  • Bit ranges are now displayed using exclusive end notation to be more consistent. For example if a field at byte offset 5 is 8 bit in size using the <byte>[.<bits>] notation it is now shown as 5-6, before it was shown as 5-5.7. See usage documentation for more examples. #789
  • Improve colors when using a light background. Thanks @adedomin for reporting. #781
  • Better from_jq error handling. Thanks @emanuele6 for reporting. #788
  • Updated gojq fork. Notable changes from upstream below. #808
    • Adds pick/1 function. Outputs value and nested values for given input expression. 
      # pick out all string values from a ELF header
$ fq '.header | pick(.. | select(type == "string"))' /bin/ls
{
  "ident": {
    "data": "little_endian",
    "magic": "\u007fELF",
    "os_abi": "sysv",
    "pad": "\u0000\u0000\u0000\u0000\u0000\u0000\u0000"
  },
  "machine": "x86_64",
  "type": "dyn"
}
# bonus tip:
# if you only need to pick one level then jq has a shortcut syntax
$ fq '.header | {type, machine}' /bin/ls
{
  "machine": "x86_64",
  "type": "dyn"
}
    • Implements comment continuation with backslash.
  • Updated gopacket to 1.2.1. Notable changes from upstream below. #815
    • fix(ip4defrag): allow final fragment to be less than 8 octets by @niklaskb
    • refactor: don't fill empty metadata slots by @smira
    • refactor: optimize port map to switch statement by @smira

Decoder changes

  • avi
    • Some general clean up fixes. Thanks to Marion Jaks at mediathek.at for testing and motivation.
    • Add extended chunks support and decode_extended_chunks option. This is trailing chunks used by big AVI files. #786
    • Add type, handler, compression (video) and format_tag (audio) per stream. #775 
      $ fq '.streams[0]' file.avi
      │00 01 02 03 04 05 06 07│01234567│.streams[0]{}: stream
0x1680│      00 00 00 01 67 f4│  ....g.│  samples[0:3]:
0x1688│00 0d 91 9b 28 28 3f 60│....((?`│
0x1690│22 00 00 03 00 02 00 00│".......│
*     │until 0x2409.7 (3464)  │        │
      │                       │        │  type: "vids"
      │                       │        │  handler: "H264"
      │                       │        │  compression: "H264"
    • Properly use sample size field when decoding samples. #776
  • exif (and tiff)
    • Handle broken last next ifd offset by treating it as end marker. #804
  • gzip
    • Correctly handle multiple members. Thanks @TomiBelan for the bug report and assistance. #795
    • Now gzip is modelled as a struct with a members array and a uncompressed field that is the concatenation of the uncompressed members.
  • macho
    • Properly respect endian when decoding some flag fields. #796
    • Move formatted timestamp to description so that numeric value is easier to access. #797
  • matroska
    • Support decoding EBML date type. #787
  • protobuf
    • No need to use synthetic fields for string and bytes. #800
  • webp
    • Refactor to use common RIFF decoder and also decode VP8X, EXIF, ICCP and XMP chunks. #803
  • zip Better timestamp support and fixes
    • Fix incorrect MSDOS time/date decoding and add extended timestamp support. Also remodel time/date to be a struct with raw values, components and a synthetics UTC unixtime guess. Thanks @TomiBelan for the bug report and assistance. #793
    $ fq '.local_files[] | select(.file_name == "a").last_modification' file.zip
    │00 01 02 03 04 05 06 07│01234567│.local_files[3].last_modification{}:
0xd0│            81 01      │    ..  │  fat_time: 0x181
    │                       │        │  second: 2 (1)
    │                       │        │  minute: 12
    │                       │        │  hour: 0
0xd0│                  73 53│      sS│  fat_date: 0x5373
    │                       │        │  day: 19
    │                       │        │  month: 11
    │                       │        │  year: 2021 (41)
    │                       │        │  unix_guess: 1637280722 (2021-11-19T00:12:02)

Changelog

  • b702218 Update docker-golang to 1.21.2 from 1.21.1
  • d704711 Update docker-golang to 1.21.3 from 1.21.2
  • c31fc87 Update docker-golang to 1.21.4 from 1.21.3
  • 861487d Update github-go-version to 1.21.2 from 1.21.1
  • d766356 Update github-go-version to 1.21.3 from 1.21.2
  • caef93c Update github-go-version to 1.21.4 from 1.21.3
  • de7fdae Update github-golangci-lint to 1.55.0 from 1.54.2
  • 60edf97 Update github-golangci-lint to 1.55.1 from 1.55.0
  • 534a2c8 Update github-golangci-lint to 1.55.2 from 1.55.1
  • 906bc3b Update gomod-golang-x-crypto to 0.14.0 from 0.13.0
  • 8d4d18d Update gomod-golang-x-crypto to 0.15.0 from 0.14.0
  • f108194 Update gomod-golang-x-net to 0.16.0 from 0.15.0
  • 5381f38 Update gomod-golang-x-net to 0.17.0 from 0.16.0
  • 14fe728 Update gomod-golang-x-net to 0.18.0 from 0.17.0
  • 1011f19 Update gomod-golang/text to 0.14.0 from 0.13.0
  • 527aad6 Update gomod-gopacket to 1.2.0 from 1.1.1
  • 0c22c79 Update make-golangci-lint to 1.55.0 from 1.54.2
  • 5f06364 Update make-golangci-lint to 1.55.1 from 1.55.0
  • 36576a5 Update make-golangci-lint to 1.55.2 from 1.55.1
  • d703321 avi: Add extended chunks support and option
  • 55521bb avi: Add stream type constants
  • 5196554 avi: Add type, handler, format_tag and compreession per stream
  • 0f225c3 avi: Add unused field for extra indx chunk space
  • df085b9 avi: Handle stream sample size
  • c7ec18d avi: Increase sample size heuristics to 32bit stereo
  • a745b12 avi: More correct strf chunk extra data
  • 9b10e59 avi: Only use sample size heuristics if there is no format
  • 23ae4d9 decode,interp: Make synthetic values more visible and not act as decode values
  • 5abf151 doc: Remove spurious backtick
  • 02b3527 exif,tiff: Handle broken last next ifd offset by treating it as end marker
  • dc376f3 gojq: Update rebased fq fork
  • ac276ee gzip: Correctly handle multiple members
  • 45a8dd9 interp: Better from_jq error handling
  • 051a70b interp: Change bit ranges to use exclusive end
  • 29e7541 interp: Fix infinite recursion when casting synthetic raw value into a jq value
  • c28163f interp: Improve colors when using light background
  • 797c7d9 macho: Move timestamp string to description
  • 71a5fc9 macho: Respect endian when decoding flags
  • 1d14ea5 matroska: Decode ebml date type
  • b24ed16 mod: Update golang.org/x/exp and github.com/gomarkdown/markdown
  • 5e2e49e protobuf: No need for synthetic for string and bytes value
  • 6034c70 webp,avi,wav,aiff: Trim RIFF id string
  • 9e58067 webp: Refactor to use riff code and decode VP8X, EXIF, ICCP and XMP chunks
  • a83cac6 zip: Fix incorrect time/date, add extended timestamp and refactor

Contributors

smira, TomiBelan, and 3 other contributors
Assets 9
Loading