BINSEQ: A Family of High-Performance Binary Formats for Nucleotide Sequences. #DataFormats #Sequencing #Genomics #Bioinformatics @biorxiv-bioinfo.bsky.social
www.biorxiv.org/content/10.1...

#OpenRewrite v8.64.0 is out! 🎯

🔲 TOML building block recipes
🤠 Migrate Jackson v3 dataformats
🍁 Switch to Maven 4
🐳 Upgrade to Testcontainers v2
🏗️ beans.xml & web.xml to Spring
💉 Field to constructor injection for Spring
🚩 OpenFeature flag removal recipes

docs.openrewrite.org/changelog/8-...

Table format significantly impacts performance! Key-value pair formats (like Markdown KV) generally outperform index-based ones (like CSV) for LLM extraction. Consider token efficiency and format trade-offs for optimal results. #DataFormats 7/7

Hacker News discussed F3, a new open-source data format tackling Parquet's flaws. Its core innovation: embedding WebAssembly (WASM) decoders directly in data files for future compatibility and flexibility. This aims to evolve encoding schemes without breaking old data. #DataFormats 1/5

I feel like the "state of the art" for designing extensible protocols is like, really really bad.

we keep making more and more complex dataformats, and I feel like none of them address the actual core issue of figuring out what should be done if an extension isn't supported

1/3

IIBA Chicagoland Chapter
Showcasing the Powers of Jupyter -
@lernerpython.com Reuven Lerner
Join us on Zoom this Wed!
Aug 6, 6:00-7:30pm CT
Cost: Free

chicago.iiba.org/.../showcasi...

#Python #Jupyter #Pandas #DataFormats #Export #Import #BusinessAnalysis

why don't we just use tables for everything? pt. 2 :)

#SemiStructuredData
#DataArchitecture
#DataPipelines
#StructuredVsUnstructured
#DataModeling
#DataStorytelling
#DataFormats
#NestedData
#Ecology
#DataScience
#CitizenScience

Comparing DuckLake to Iceberg/Delta Lake, users noted DuckLake's approach to preserving time travel even after data compaction as a potential advantage. Discussions weighed its architecture against established formats. #DataFormats 4/6

Effective chunking and versioning are crucial for file format longevity. They enable backward/forward compatibility and allow for partial processing or reordering of data blocks. Plan for evolution from the start. #DataFormats 3/6

Despite issues, CSV endures due to simplicity & Excel compatibility. High-speed parsing matters for huge files, but users debate if it's worth it vs structured formats like Parquet or HDF5. #DataFormats 4/6

CBOR vs MessagePack: Technical deep-dive reveals CBOR's advantages in serialization formats
https://taylor.town/flat-scraps-001
#serialization #cbor #messagepack #dataformats #performance

You should add Magica Voxel .vox file support. It is documented paulbourke.net/dataformats/... and github.com/ephtracy/vox.... I've used this library to load .vox files, and it writes them also github.com/jpaver/openg...

#GSPy - A New #Toolbox & #DataStandard For #Geophysical #Datasets
-
doi.org/10.3389/fear...
-
#GIS #spatial #mapping #geophysics #NetCDF #datatypes #code #opensource #library #dataformats #standardisation #openstandard #metadata #Python #package #workflows #xarray #opendata #architecture #toolbox

Is there a group of good pretty format plugins for #neovim? That covers dataformats? JSON, XML, logfmt would be nice too.

If it doesn't look like a straight-up .txt file, it's not a reliable specification.

paulbourke.net/dataformats/...

I see WOW's value names for automatic weather station obs (tempf etc) are pretty much identical to Wunderground. - <a href="http://wow.metoffice.gov.uk/support/dataformats#pressure" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link" target="_blank" rel="noopener" data-link="bsky">http://wow.metoffice.gov.uk/support/dataformats#pressure

http://PDFConverter.com Lets You Convert A #Document From/To #PDF http://goo.gl/fb/ukkTh #technology #converter #dataformats