Markutils

From The Hei Canon

markutils is a small grab-bag of data and model utilities. Written by Hei (Hei).

Stack: Python. Public repo, install via pip install git+https://github.com/marksverdhei/markutils.git.

CLI

# Convert between csv / tsv / json / jsonl / parquet (format inferred from extension)
markutils convert input.csv output.parquet

# Print tensor shapes from a safetensors checkpoint
markutils inspect model.safetensors

Library

  • markutils.utils.data.load_dataframe / save_dataframe — the same format-roundtrip helpers.
  • markutils.checkpoints.get_state_dict / print_state_dict_shapes — safetensors inspection.

Sources

Retrieved from "/index.php?title=Markutils&oldid=704"