Foreward: Thanks so much for your work on this! We found the types in this library to be much more comprehensive than the canon apache arrow js implementation, and also appreciate that tableFromIPC does not attempt to do unsafe string evaluation via function construction (we send arrow data to the browser, so we would have to allow unsafe-eval to use the original library)
We have a use case where we return just the schema of an arrow table in our backend. We are looking to have something close to pyarrow.ipc.read_schema - which apache arrow's JS implementation does support by way of MessageReader, but unfortunately does not support all of the core types, most importantly the LargeList
From reading the decoder source, it looks like decodeSchema might be what we're looking for, but this isn't exported. Would you guys be open to exporting this and the other decoder subfunctions?
Foreward: Thanks so much for your work on this! We found the types in this library to be much more comprehensive than the canon apache arrow js implementation, and also appreciate that
tableFromIPCdoes not attempt to do unsafe string evaluation via function construction (we send arrow data to the browser, so we would have to allowunsafe-evalto use the original library)We have a use case where we return just the schema of an arrow table in our backend. We are looking to have something close to
pyarrow.ipc.read_schema- which apache arrow's JS implementation does support by way ofMessageReader, but unfortunately does not support all of the core types, most importantly theLargeListFrom reading the decoder source, it looks like
decodeSchemamight be what we're looking for, but this isn't exported. Would you guys be open to exporting this and the other decoder subfunctions?