Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Profiling tool: Structured output format #3047

Closed
nartal1 opened this issue Jul 27, 2021 · 0 comments · Fixed by #3342
Closed

[FEA] Profiling tool: Structured output format #3047

nartal1 opened this issue Jul 27, 2021 · 0 comments · Fixed by #3342
Assignees
@tgravescs
Labels
feature request New feature or request P1 Nice to have for release
Milestone
Aug 30 - Sept 10

Comments

@nartal1
Copy link
Collaborator

nartal1 commented Jul 27, 2021

Is your feature request related to a problem? Please describe.
As a user, I want to save the output of the profiling tool(for "Job + Stage level aggregated task metrics" and "SQL level aggregated task metrics" 2 sections) as structured output format csv/parquet so that I can analyze using custom queries.

Additional context
Acceptance criteria: Able to run customized queries on aggregated task metrics for all processed applications.
@nartal1 nartal1 added feature request New feature or request ? - Needs Triage Need team to review and classify P1 Nice to have for release labels Jul 27, 2021
@tgravescs tgravescs removed the ? - Needs Triage Need team to review and classify label Jul 27, 2021
@tgravescs tgravescs self-assigned this Aug 6, 2021
@tgravescs tgravescs mentioned this issue Aug 30, 2021
Merged
@tgravescs tgravescs added this to the Aug 30 - Sept 10 milestone Sep 2, 2021
@sameerz sameerz changed the title [FEA]Profiling tool: Structured output format [FEA] Profiling tool: Structured output format Sep 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tgravescs tgravescs

Labels
feature request New feature or request P1 Nice to have for release
Projects
None yet
Milestone
Aug 30 - Sept 10
Development

Successfully merging a pull request may close this issue.

Profiling tool add CSV output option and add new combined mode tgravescs/spark-rapids
2 participants
@tgravescs @nartal1