Skip to content

How to specify start and end times? #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nalcabio-tom opened this issue Feb 25, 2025 · 3 comments
Closed

How to specify start and end times? #5

nalcabio-tom opened this issue Feb 25, 2025 · 3 comments

Comments

@nalcabio-tom
Copy link

I see these in the source code in this repo, but I don't know how to overwrite them from the superset dashboard. These appear to default to the last ten minutes from now. Thanks!

@nalcabio-tom
Copy link
Author

Whoops. I think I understand now. p_timestamp is expected to be in the query and this is used to extract the start and end times. We have our own timestamp so we weren't including p_timestamp.

@AdheipSingh
Copy link
Collaborator

@nalcabio-tom every event ingested into parseable has p_timestamp by default

@nalcabio-tom
Copy link
Author

Yes, I understand that. What I still don't understand however is how to set the start and end times in the data that's sent to parsable by sqlalchemy-parseable: #8. These start and end times are sent in separate fields in the json payload posted to parseable. It's not enough to simply include them in the SQL query: https://www.postman.com/parseable/parseable/documentation/ds62z97/log-stream-query?entity=request-22353706-7b281b33-2f37-4034-9386-9a78e37b1db1

What appears to be the case, what prompted this particular issue, is that a SQL query in superset must include p_timestamp or else sqlalchemy-parseable won't send any start and end times to parseable? Or at least no data will ever be returned by parseable. For data to be returned, p_timestamp must be included in the SQL query somewhere. But no matter what time range is used in the SQL query with p_timestamp, only the last 10 minutes will ever be searched by parseable.

Would it be possible to specify start and end times some other way than by grepping for p_timestamp in the SQL query? Could this be done in a specially formatted comment, for example?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants