981 questions
0
votes
0
answers
118
views
Converting (I think) hexidecimal data to an image; possibly Delphi file format
NOTE: I deliberately didn't tag this with Python, even though that's what the code I've tried so far has been in, because I'm happy to use any language to solve this, it's really a data conversion ...
- 9
1
vote
0
answers
32
views
Can I store LH coordinate data in GLTF by defining root node with LH coordinate conversion matrix in the root of the scene
I am planning to write my own 3D rendering engine with LH coordinate system and I want to use GLTF as main scene description format
But while GLTF is define strictly as RH coordinate system. I think ...
- 1,512
0
votes
0
answers
35
views
Syntax Error When Using PROC to Load Data to Stage from SFTP in Snowflake
I am facing an issue getting data from SFTP to the STAGE I have created. In the below, I create a FILE FORMAT, then a STAGE and finally use an already created STORED PROCEDURE to load the data. I ...
- 323
0
votes
1
answer
81
views
how to escape double quote backslash in snowflake file format
My csv file has fields which in enclosed with double quotes and the fields are separated with |. For some of the fields i have below value in csv file:
|"\"Bremen \""|
I want to ...
- 3,879
0
votes
1
answer
75
views
How can I parse text from a *.PG type file?
I have some configuration (backup) files of a Siemens S7-300 PLC with the extension *.PG. Some other files have the extension *.DBF and can be read with the OLEDB Connection. But it is not possible to ...
- 789
0
votes
1
answer
226
views
How to detect if a Windows PE executable is for native code vs managed code? [duplicate]
I've been analysing Windows PE executables' binary file format.
I know how to differentiate PE32 (32 bit) vs PE32+ (64 bit) and how to differentiate x86 vs x64.
But I know that managed code uses the ...
- 17k
0
votes
0
answers
108
views
What Machine Type does 0xEC20 indicate in a PE file?
In the Windows PE file (Portable Executable) file format, the 16-bit field right after the PE\0\0 signature of the PE header is the "Machine Type" field.
Microsoft currently lists about 30 ...
- 17k
0
votes
0
answers
59
views
How can I Run/Extract/Or view a KPA file
I was coping files from a Dx3 VTech Watch and I found in the apps section a .kpa file and Im curious on how I can view it.
Ive noticed its a binary file
If you want to take a look at the files I ...
2
votes
1
answer
114
views
Split mrc file into pieces by using DM script
I'm working with Digital Micrograph (DM) and have an MRC file that contains 10 distinct pieces. When loaded in DM, I can navigate through these pieces using the left and right arrow keys. I'm looking ...
- 257
1
vote
1
answer
112
views
Reading and manipulating a 3D stack of MRC images
The problem I am trying to solve is a three-parter.
I am trying to read a 3D stack of MRC images (not as in: Can DM script read images with the same extension (like *.mrc) from a folder?), apply a ...
- 67
1
vote
2
answers
75
views
Using Powershell 7 test files for unix or windows format
I have a vendor who sends 5-10 files a month. Recently they started sending us a mixture of Unix format files among the Windows format files. This vendor is notoriously difficult to work with so this ...
- 315
0
votes
0
answers
92
views
.npy to .aedat4 to view videos from event camera (davis346)
Got a dataset recorded from davis346, which is an event-based camera from iniVation. But every file in the dataset ends with .npy. I want to convert them to aedat4 or some other formats for ...
0
votes
0
answers
153
views
Why does it fail to detect WAVE or RIFF?
I'm trying to load a wav file into a C++ app
I Keep getting the program to print Invalid Wav File with exit code 5. This means the program thinks the chunkID didn't match RIFF or the format didn't ...
- 29
1
vote
1
answer
175
views
How to store metadata for a UTF-8 text file cross-platform?
I'm looking for a cross-platform way of storing small amounts of metadata for UTF-8 text files. Things like current selection and cursor position. I know about filesystem-specific solutions like using ...
0
votes
0
answers
42
views
json file (line delimited) on GCS incorrect when private - correct when public
I am trying to load a json (newline delimited) file stored on a private GCS bucket using ibis. I get the following error:
Invalid Input Error: Malformed JSON in file "<<<URL>>>&...
1
vote
1
answer
50
views
Troubleshooting Multi-Slice Volume Loading Issues in NRRD Files
What's wrong with this NRRD file? When loading a single slice, it works correctly, but when loading multiple slices to generate a volume, it fails to load. The file is:
NRRD0004
# Complete NRRD file ...
1
vote
1
answer
76
views
Adding my own transpiled file format to Typescript imports
I just want to import a file format .xyz whose types are not fixed over all instances of the format:
import { Comment, Article, User } from "./Blog.xyz"
But what I get is the following:
...
0
votes
1
answer
84
views
Problems uploading a .tar file
I am working with a file in .tar.Z format. I manually changed its name so it would only have the .tar extension, and I'm currently struggling to open it and read the data. I can't seem to find what ...
0
votes
1
answer
499
views
How to read a JT file?
I want to implement a JT file reader in C++. The JT File Format Reference documents the file format. I came up with the following "minimal" example (note: I am only interested in the vertex ...
- 8,200
2
votes
1
answer
734
views
Snowflake external table that sits over csv files, not handling nulls as expected
I have many external tables that sits over csv files in S3. I have string values in numeric columns that should be parsed as null, e.g. 'na'. when I query the stage with the file format, this works as ...
- 443
1
vote
0
answers
140
views
Writing Cue Data into RF64 WAV File
I'm not entirely sure if StackOverflow is the right site for this question, but I looked at all the other sites in the StackExchange network and none of those seemed more suitable, so apologies if ...
- 76
2
votes
4
answers
848
views
Parsing CSV file with JSON data in Golang
I've a CSV File having data in below format.
Date,RestaurantId,ItemRatings
2023-10-08,232,[{"item_id":8215117,"item_name":"The Farmers Breakfast","current_day_count&...
- 87
0
votes
0
answers
502
views
Snowflake File Format - How to handle double quotes and acute symbols when loading data in Snowflake
I’m trying to load records into a table in Snowflake and some fields are enclosed with both double quotes and the acute symbol. It looks like there’s only 3 options for the ...
2
votes
1
answer
737
views
Understanding SizeOfHeaders
Learning some nasm, and file formats for my assembly project. I am currently very confused about SizeOfHeaders.
Taking a look at the official documentation:
The size of the PE header and the section (...
- 182
0
votes
0
answers
82
views
Different ffmpeg result after saving to png
Saving images to PNG first seems to produce different ffmpeg encodes. Running this test code
from PIL import Image
import cv2
import ffmpeg
import hashlib
ffmpeg.input('test.jpg').output('testff.png'...
- 617
1
vote
1
answer
348
views
Directory size increased after compaction using pyspark
I wrote a file compactor using pyspark.
The way that it works is by reading all the content of a directory into a spark dataframe and then performing a repartition action in order to reduce the number ...
3
votes
4
answers
25k
views
Unable to read text data file using TextLoader from langchain.document_loaders library because of encoding issue
My end goal is to read the contents of a file and create a vectorstore of my data which I can query later.
from langchain.embeddings.openai import OpenAIEmbeddings
from langchain.text_splitter import ...
- 3,298
0
votes
0
answers
183
views
Searching Working C/C++ DDS Image Library
Im searching a working DDS image loading library written in C/C++, so far I have tried:
raylib, DevIL and dedicated DDS image libraries
All of them don't work properly, the image looks completely ...
- 333
4
votes
1
answer
1k
views
Offset from the start of the “mdat” box to the first frame
As a personal programming challenge, I have decided to write an MP4 decoder without using external libraries. To achieve this, I am using VB.NET with the .NET Framework 4.8.1 as a WinForms application,...
- 552
0
votes
1
answer
104
views
Learning IDAT in detail
I have a broken png file where compression CMF is 0x28 and FLG is 0xB5 in the IDAT chunk. As far as i know it shouldn't be a valid IDAT header. Can anyone tell me if this CMF and FLG byte is valid?If ...
- 16
0
votes
1
answer
63
views
canvas.toDataURL("image/jpeg") can't be used in .drawImage()
I am trying to capture a canvas screen using canvas.toDataURL("image/jpeg") and then use it in ctx.drawImage();, but it gives the error "Uncaught TypeError" saying that the image ...
0
votes
1
answer
190
views
Feeding data to Cytoscape and running
I am a Window programmer and would like to find a way to write a text data file containing basic node and edge information and properties (labels, properties, weights, etc.). It would not include ...
- 113
1
vote
3
answers
400
views
Can we write/prepare Fixed Width Length file type in Nifi?
I have an input JSON, and I want to convert that JSON to a Fixed width length file format.
I wanted to know if there is any way I can convert the JSON file to Fixed Width length file format in Nifi, ...
- 64
0
votes
1
answer
670
views
How to convert custom dataset json file to yolov8 text file format in python
I pulled the class names and x,y points I needed from the json file and created a csv file. This csv file contains rows for multiple regions for each image. For example, while there are 5 regions for ...
- 1
1
vote
1
answer
1k
views
Is there a way I can see '\0' (null character) in Visual Studio's text editor?
I am making my own file format. It looks like so:
<GameObjects>
{
<GameObject>
{
<int id> 0
<std::string name> GameObject0
<Transform>
...
0
votes
0
answers
105
views
How to read a .gdf file into an igraph object - R package igraph
I'd like to read a .gdf file into igraph. Is there a function that does this and returns an igraph object? Im using the igraph R package
I came across "read_graph()" when looking through the ...
- 33
3
votes
0
answers
503
views
SNOWFLAKE - Single file generation even though the max size exceeds
I have a query to discuss: Table to file creation in snowflake
We have used the max file size with the compression, but at some times the data which is retrieving and size it is storing in the file ...
- 399
-1
votes
1
answer
605
views
How to open a .o file in windows
I have a simple code and was learning how a C program get's compiled
This code was given to make the intermediate temporary files .i, .o and .s
I was able to view and sort of get the .i and .s files ...
- 15
0
votes
1
answer
157
views
Text extraction from a file format unknown to me
I have a lot of files obviously stemming from some web publishing system (unidentified) and want to convert them to plain text. The file format is characterised by a lot of curly braces, square ...
- 665
0
votes
0
answers
76
views
File Format to Write out map data
I want to write out the hashmap in java, having Key:String and Value:List<UserInfo>.
The UserInfo object has (id, name, category, type) vaues.
Can someone suggest the file format to writeout the ...
0
votes
1
answer
1k
views
How to Unescape a character in snowflake during data ingestion from CSV to Snowflake table
I have a process that automatically ingests CSV data into Snowflake Tables from an external stage. CSV File that has the delimiter as pipe (vertical bar or | )
But one cell has data that contains the ...
- 49
0
votes
2
answers
145
views
rename AWS glue output file as .json/.parquet
I have below code which writes data into AWS s3 location using Glue job, but at the end it is saving in part file, but my requirement is to save filename as filename.json or filename.parquet
s3_loc = ...
1
vote
0
answers
932
views
Converting webp to png with .NET in Unity
So, I have a webp image bytes which I get from decoding base 64 string, but the thing is that Unity can not understand webp Images, so I have changed Unitys default .NET 2.1 to .NET Framework 4.x to ...
- 33
0
votes
1
answer
31
views
So I have this drag and drop functionality on this page but I want only the files in this format to be uploaded Name-YYYY-MM-DD_hh-mm-ss-uuuu.jpeg
So I have this drag and drop functionality on this page but I want only the files in this format to be uploaded Name-YYYY-MM-DD_hh-mm-ss-uuuu.jpeg .
currently drag and drop takes any file that ends in ...
- 1
0
votes
1
answer
915
views
What permissions do we need to create file_format in Snowflake
I am trying to create file_format to create stage in snowflake with custom role. I have assigned privileges to create stage and use the storage integrations, schema, database but it is still showing ...
- 1
0
votes
0
answers
382
views
CSV to Snowflake - Converts some data to Uppercase Automatically
Hello Techies,
Thanks for your time in reading this and trying to help.
I have a peculiar situation where I have a CSV file with data (separated by commas) in an external stage. I have snowflake ...
- 49
1
vote
0
answers
152
views
Do the 5-byte and 9-byte binary zip comments at the end of .jar files serve some purpose, or are they likely due to an uninitialized buffer bug?
.jar files as used by Java and Kotlin are a specialization of the .zip file format. They must contain certain files and/or directories, and they may only use a restricted subset of the full features ...
- 17k
0
votes
1
answer
212
views
A graph description language for binary streams (network packets, binary file formats)
I'm looking for a graph description language to document binary streams like network packets or binary file formats (described in code, then output as a graph).
Something in the same idea that DOT/...
- 11
0
votes
1
answer
41
views
AudioGraph created files works in VLC but not elsewhere
I've written a program that produces wav files using the WinRT AudioGraph API.
VLC plays the files fine, and displays the correct length.
But when trying to load the files in python
torchaudio, ...
- 3,455
0
votes
0
answers
14
views
Does Python have a native output file format? [duplicate]
Does Python have a native output file format? For example, SAS has native data sets (*.sas7bdat files). Does Python have an equivalent?
- 13