this post was submitted on 11 Dec 2023
28 points (96.7% liked)

Programming

17418 readers
25 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 1 year ago
MODERATORS
 

cross-posted from: https://lemmy.nz/post/4294116

I have a file with content like this:

item({
     ["attr"] = {
        ["size"] = "62091";
        ["filename"] = "qBuUP9-OTfuzibt6PQX4-g.jpg";
        ["stamp"] = "2023-12-05T19:31:37Z";
        ["xmlns"] = "urn:xmpp:http:upload:0";
        ["content-type"] = "image/jpeg";
     };
     ["key"] = "Wa4AJWFldqRZjBozponbSLRZ";
     ["with"] = "email@address";
     ["when"] = 1701804697;
     ["name"] = "request";
});

I need to know what format this is, and if there exists a tool in linux already to parse this or if I need to write one myself?

Thanks!

top 18 comments
sorted by: hot top controversial new old
[–] flubba86@lemmy.world 28 points 11 months ago* (last edited 11 months ago) (2 children)

It's not really a standalone file format, it's executable Lua code.

It returns a new item with the given table contents.

That syntax with the keys in square brackets is the "long-form" method of creating a new table, that's allows the use of spaces and dashes in the key name.

https://stackoverflow.com/questions/34687498/what-is-the-function-of-square-brackets-around-table-keys-in-lua

Maybe this is the lua-equivelent of a python Pickle file?

[–] luthis@lemmy.nz 4 points 11 months ago (1 children)

Ohhhhh...

Ok so I just have to write a bit of Lua to utilise the file and give me the info I want.

Thanks!

[–] vrighter@discuss.tchncs.de 5 points 11 months ago* (last edited 11 months ago) (1 children)

assuming you run it in the right lua environment. The item function must be defined, and we're only speculating about its return value without seeing proper docs, or the source

[–] luthis@lemmy.nz 5 points 11 months ago (1 children)

Item is a function?

Well actually, yeah thats kinda obvious isn't it now I look at the whole thing.

Thats fine, I'll just use a bit of the old sed and json it.

Aha I have avoided learning Lua yet again!

[–] vrighter@discuss.tchncs.de 2 points 11 months ago (2 children)

the code is constructing a table, and passing it to a function called item. But if all you need is the data, you can just remove the function call and assign the table to a variable like so: local myvar = {...}.

then you can just manipulate the table as usual.

[–] luthis@lemmy.nz 3 points 11 months ago

Unfortunately, this sequence is repeated many many times, so I would need to do a for-each and construct a new table for each inner section..

There's gotta be a better way. Time to read the source code and hijack whatever item() is doing.

[–] vrighter@discuss.tchncs.de 2 points 11 months ago

actually those semicolons indicate this isn't actually lua, they are invalid in table constructors afaik

[–] Jummit@lemmy.one 2 points 11 months ago* (last edited 11 months ago) (1 children)

~~This isn't Lua code, Lua requires commas as separators for table items.~~

EDIT: Retracted, it seems like Lua allows this madness

[–] Celediel@slrpnk.net 6 points 11 months ago (1 children)
[–] Jummit@lemmy.one 3 points 11 months ago

Wow. Seems like I will never stop learning new things about Lua.

[–] kool_newt@lemm.ee 4 points 11 months ago
[–] 56_@lemmy.ml 3 points 11 months ago* (last edited 11 months ago)

I think it's just normal Lua code.

Here's a quick json converter (based on https://stackoverflow.com/a/55575074), assuming you have lua installed:

local function to_json(obj)
    local result = {}
    for key, value in pairs(obj) do
        if type(value) == "string" then
            value = string.format("\"%s\"", value)
        elseif type(value) == "table" then
            value = to_json(value)
        end
        table.insert(result, string.format("\"%s\":%s", key, value))
    end
    return "{" .. table.concat(result, ",") .. "}"
end

function item(obj)
    print(to_json(obj))
end

dofile(arg[1])

It just defines the item function to print json, and executes the data file.

arg[1], the first command line argument, is the path to the data file:

$  lua to_json.lua path/to/datafile.list

and pipe the output to something.json or whatever else you want to do.

[–] draughtcyclist@programming.dev 1 points 11 months ago (1 children)

Almost looks like mongodb output. What's the file extension?

[–] luthis@lemmy.nz 1 points 11 months ago

It's .list

I believe the program that generated this file is written in Lua

[–] syd@lemy.lol 0 points 11 months ago* (last edited 11 months ago) (1 children)

WTH is this shit? @postwatchbot@lemy.lol

[–] Discover5164@lemm.ee 5 points 11 months ago

lua code apparently

[–] Saganaki@lemmy.one -1 points 11 months ago* (last edited 11 months ago) (1 children)

Looks like somebody rewrote json to require brackets around keys and to require semicolons? Very likely custom.

[–] luthis@lemmy.nz 1 points 11 months ago

The semi-colons threw me off.. why is it not commas? Could be custom. Hope it isn't..