7,423
questions
2
votes
0
answers
20
views
GO WebSocket to stream public Mastodon posts gives bad handshake
I am trying to stream public posts from Mastodon in real-time using WebSockets and retrieving public posts using the API. However, I am encountering a issue bad handshake error when using WebSocket.
...
- 1,160
0
votes
0
answers
31
views
Get ingestion date for Snowflake rows without using default expression
I am using Snowpipe Streaming API to ingest data from Kinesis with minimal latency. The API works as expected, however for the monitoring purposes we would like to know the actual latency for events, ...
- 2,163
-2
votes
0
answers
8
views
How to implement volumeBar K-line in stream computing?
How can I implement a function similar to volumeBar on streaming data?
I have a streaming table of ticks and I want to segment K-lines based on volume, for example, creating a new bar for every 10,000 ...
0
votes
0
answers
16
views
Returning search results from a NextJS API endpoint incrementally
I have an /api/search endpoint in my NextJS application which kicks off 5 different searches for a given query string. Some return much sooner than others, so I want to return results as they're ...
- 4,562
0
votes
0
answers
58
views
How to real-time stream or seek in log files (tail -f) stored in azure blobs
When testing logging using Loki and Promtail, I noticed that tailing from azure blob storage was not working properly. It starts to tail the first few lines, then stops till a new blob file is written ...
- 43
0
votes
0
answers
28
views
What's the most efficient way to stream data to S3 using aioboto3
I'm trying to implement a true streaming solution from an API to S3 using aioboto3. The data flow is:
Fetch data from API using pagination (each page returns N items)
Stream each item directly to S3
...
0
votes
0
answers
55
views
Go `io.Copy` doesnot transfer whole file through the network [closed]
I have encountered a very weird issue where when transferring data through the network, io.Copy(conn, srcFile) doesnot transfer 100% of the data in srcFile.
What's weird is that if I wrap conn and ...
- 165
0
votes
0
answers
48
views
How to send stream data as a response in Python FastAPI? [duplicate]
I am able to get streaming data. I am using python FastAPI. How can I send the streaming data as a response and use it in front-end. I am struck at this position right now. This is the code:
Streaming ...
- 123
0
votes
0
answers
39
views
Error 403 While Downloading Youtube Video Using ytdl-core [duplicate]
I was working on a Project where I'm attempting to download a video file, audio file, and a merged version into a single complete video using ytdl-core.
But while downloading video file only it give ...
0
votes
0
answers
12
views
Not triggering the clear state timers in Apache Beam
I am posting the complete code here, since I have been trying it for days but no output yet
This is a popular code, which is explained by the Apache Beam team and is available on YT.
Here is the Link :...
- 151
0
votes
1
answer
30
views
How to store streaming messages from openai to chat history database?
I have a RAG chatbot where the frontend and backend are running on different ports.
We use a REST API to communicate between them,
the issue is, I am trying to store the "user" message and &...
0
votes
1
answer
54
views
Setting resolution for WebRTC using Unity Render Streaming to stream video file in a specific resolution
I have a video file of a 360 video on my computer that I am streaming it to Unity using skybox. The video original resolution is 1920x960, but when I view it inside Unity the resolution is clearly ...
0
votes
1
answer
34
views
Spark streaming `initialPosition` vs `startingPosition`?
What's the difference between initialPosition and startingPosition in spark streaming? I've gone through spark docs, delta table docs, O'Reilly guide, ... and they mention both, but not the difference ...
- 3,442
0
votes
0
answers
6
views
How can I achieve results similar to fj in stream computing?
daily.csv contains daily static data (the right table), and tick.csv contains some partial CTP market data (the left table). I want to merge each new TICK with the InstrumentID in daily (the join ...
- 111
0
votes
0
answers
44
views
How to Load and Parse a Large PDF from Stream Chunk by Chunk Without Loading It Completely into Memory?
I'm currently working on a project that involves loading and parsing a large PDF file (over 2GB) from a stream without loading the entire file into memory. I have created a ReadStream from Google ...
- 1