Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Qualification tool: update SQL Df value used and look at jobs in SQL #5612

Merged
merged 141 commits into from
May 24, 2022

Commits on May 10, 2022

  1. QualificationTool. Add speedup information to AppSummaryInfo

    Signed-off-by: Ahmed Hussein (amahussein) <a@ahussein.me>
    amahussein committed May 10, 2022
    Configuration menu
    Copy the full SHA
    55c8384 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2022

  1. address review comments

    Signed-off-by: Ahmed Hussein (amahussein) <a@ahussein.me>
    amahussein committed May 11, 2022
    Configuration menu
    Copy the full SHA
    82a5a9b View commit details
    Browse the repository at this point in the history
  2. debug

    tgravescs committed May 11, 2022
    Configuration menu
    Copy the full SHA
    9d0cbc3 View commit details
    Browse the repository at this point in the history
  3. check for dataset

    tgravescs committed May 11, 2022
    Configuration menu
    Copy the full SHA
    af060fb View commit details
    Browse the repository at this point in the history
  4. change dataset check for all

    Signed-off-by: Thomas Graves <tgraves@apache.org>
    tgravescs committed May 11, 2022
    Configuration menu
    Copy the full SHA
    ed74657 View commit details
    Browse the repository at this point in the history
  5. test unsupported time

    tgravescs committed May 11, 2022
    Configuration menu
    Copy the full SHA
    17b39c7 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2022

  1. more changes

    tgravescs committed May 12, 2022
    Configuration menu
    Copy the full SHA
    6b2d419 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2022

  1. fix to string

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    c14e2e3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    da9665d View commit details
    Browse the repository at this point in the history
  3. put unsupported Dur

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    a68deae View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c965c1c View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    53668a4 View commit details
    Browse the repository at this point in the history
  6. combine

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    480ddee View commit details
    Browse the repository at this point in the history
  7. hooking up final output

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    c7aa64b View commit details
    Browse the repository at this point in the history
  8. initial scores changes

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    9b09b23 View commit details
    Browse the repository at this point in the history
  9. logging

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    5ad9ec4 View commit details
    Browse the repository at this point in the history
  10. logging

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    5af6d70 View commit details
    Browse the repository at this point in the history
  11. update factor

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    3abed14 View commit details
    Browse the repository at this point in the history
  12. gturn off some logging:

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    c0f3bb5 View commit details
    Browse the repository at this point in the history
  13. debug

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    b8b0ad9 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    e941ca4 View commit details
    Browse the repository at this point in the history
  15. track execs without stages

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    718a32a View commit details
    Browse the repository at this point in the history
  16. Add in exec info output

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    14419e8 View commit details
    Browse the repository at this point in the history
  17. fix output

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    1a1b5d1 View commit details
    Browse the repository at this point in the history
  18. add sorting

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    f715975 View commit details
    Browse the repository at this point in the history
  19. fix output

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    5fbe980 View commit details
    Browse the repository at this point in the history
  20. fix output sizes

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    aaf3873 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    ad365cd View commit details
    Browse the repository at this point in the history
  22. output children node ids

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    e5c3551 View commit details
    Browse the repository at this point in the history
  23. output stages info

    tgravescs committed May 13, 2022
    Configuration menu
    Copy the full SHA
    851b712 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2022

  1. cleanup

    tgravescs committed May 16, 2022
    Configuration menu
    Copy the full SHA
    16d88c3 View commit details
    Browse the repository at this point in the history
  2. fix running app

    tgravescs committed May 16, 2022
    Configuration menu
    Copy the full SHA
    f391f28 View commit details
    Browse the repository at this point in the history
  3. fix stage header

    Signed-off-by: Thomas Graves <tgraves@apache.org>
    tgravescs committed May 16, 2022
    Configuration menu
    Copy the full SHA
    66c02aa View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1fdd4ff View commit details
    Browse the repository at this point in the history

Commits on May 17, 2022

  1. Update summary table

    tgravescs committed May 17, 2022
    Configuration menu
    Copy the full SHA
    7b07645 View commit details
    Browse the repository at this point in the history
  2. cleanup

    tgravescs committed May 17, 2022
    Configuration menu
    Copy the full SHA
    7f9ce84 View commit details
    Browse the repository at this point in the history
  3. fix sorting

    tgravescs committed May 17, 2022
    Configuration menu
    Copy the full SHA
    f3747df View commit details
    Browse the repository at this point in the history
  4. update running app

    tgravescs committed May 17, 2022
    Configuration menu
    Copy the full SHA
    0d12a73 View commit details
    Browse the repository at this point in the history
  5. update test

    tgravescs committed May 17, 2022
    Configuration menu
    Copy the full SHA
    0da6523 View commit details
    Browse the repository at this point in the history
  6. fix missing

    tgravescs committed May 17, 2022
    Configuration menu
    Copy the full SHA
    e17f99b View commit details
    Browse the repository at this point in the history

Commits on May 18, 2022

  1. Configuration menu
    Copy the full SHA
    6ff627e View commit details
    Browse the repository at this point in the history
  2. fixes

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    d576e05 View commit details
    Browse the repository at this point in the history
  3. fix test

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    0ed07c7 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d4b30a0 View commit details
    Browse the repository at this point in the history
  5. fix df duration

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    cec6671 View commit details
    Browse the repository at this point in the history
  6. debug

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    b86debd View commit details
    Browse the repository at this point in the history
  7. debug

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    cc1c7ca View commit details
    Browse the repository at this point in the history
  8. fix double and int

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    beecfe1 View commit details
    Browse the repository at this point in the history
  9. fix double

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    9ee8245 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    ce1fe51 View commit details
    Browse the repository at this point in the history
  11. fxi merge

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    2fa41d7 View commit details
    Browse the repository at this point in the history
  12. fix double

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    ab7a490 View commit details
    Browse the repository at this point in the history
  13. fix divide 0

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    f9e9869 View commit details
    Browse the repository at this point in the history
  14. fix double to 2 precision

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    2d5ac8a View commit details
    Browse the repository at this point in the history
  15. fix formatting output

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    cc9cdc1 View commit details
    Browse the repository at this point in the history
  16. fix sorting

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    6935f83 View commit details
    Browse the repository at this point in the history
  17. fix Running

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    6ef010f View commit details
    Browse the repository at this point in the history
  18. move around sorting

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    30bf186 View commit details
    Browse the repository at this point in the history
  19. remove logWarnings

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    cc1686e View commit details
    Browse the repository at this point in the history
  20. update sorting

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    dad9610 View commit details
    Browse the repository at this point in the history
  21. Add appId to execs report

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    4c25dc5 View commit details
    Browse the repository at this point in the history
  22. update sxtages output

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    56c0f72 View commit details
    Browse the repository at this point in the history
  23. remove unused imports

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    4539f1e View commit details
    Browse the repository at this point in the history
  24. fix running app

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    56a5527 View commit details
    Browse the repository at this point in the history
  25. update tests

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    43d4a4e View commit details
    Browse the repository at this point in the history
  26. fix sorting

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    8e61126 View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    cae9209 View commit details
    Browse the repository at this point in the history
  28. fix running

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    7da0719 View commit details
    Browse the repository at this point in the history
  29. try using enum

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    56bb07b View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    493a5af View commit details
    Browse the repository at this point in the history
  31. Configuration menu
    Copy the full SHA
    4d55c27 View commit details
    Browse the repository at this point in the history
  32. fix ecommendation

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    a8776e1 View commit details
    Browse the repository at this point in the history
  33. fix divide 0

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    9d4765b View commit details
    Browse the repository at this point in the history
  34. fix opportunity

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    5afce2c View commit details
    Browse the repository at this point in the history
  35. fix up df task duration

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    25d4c0b View commit details
    Browse the repository at this point in the history
  36. debug

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    e9cc761 View commit details
    Browse the repository at this point in the history
  37. Configuration menu
    Copy the full SHA
    ae3be31 View commit details
    Browse the repository at this point in the history
  38. rearrange codce

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    b25f88a View commit details
    Browse the repository at this point in the history
  39. cleanup

    tgravescs committed May 18, 2022
    Configuration menu
    Copy the full SHA
    a832316 View commit details
    Browse the repository at this point in the history
  40. Configuration menu
    Copy the full SHA
    32f0545 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2022

  1. handle failures and cleanup

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    152a01c View commit details
    Browse the repository at this point in the history
  2. fix output

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    13f42ba View commit details
    Browse the repository at this point in the history
  3. change sorting

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    36a3e0f View commit details
    Browse the repository at this point in the history
  4. fixies

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    89d70fa View commit details
    Browse the repository at this point in the history
  5. handle test having udf

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    2d5303c View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    b8ab8cd View commit details
    Browse the repository at this point in the history
  7. fix test

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    ef25228 View commit details
    Browse the repository at this point in the history
  8. fix ui after changing field names

    Signed-off-by: Ahmed Hussein (amahussein) <a@ahussein.me>
    amahussein committed May 19, 2022
    Configuration menu
    Copy the full SHA
    96032d3 View commit details
    Browse the repository at this point in the history
  9. make ExecInfo regular class

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    9c9f825 View commit details
    Browse the repository at this point in the history
  10. Merge pull request #5 from amahussein/qualStageMetrics-ui-check

    fix ui after changing field names
    tgravescs authored May 19, 2022
    Configuration menu
    Copy the full SHA
    cf9aad2 View commit details
    Browse the repository at this point in the history
  11. fix commented out

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    1554564 View commit details
    Browse the repository at this point in the history
  12. fix more execinfo

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    0268e34 View commit details
    Browse the repository at this point in the history
  13. update test schema

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    7c8e6a7 View commit details
    Browse the repository at this point in the history
  14. change what goes to DF

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    40dc9a7 View commit details
    Browse the repository at this point in the history
  15. move to outer class

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    fc980a1 View commit details
    Browse the repository at this point in the history
  16. fix schema

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    727eae5 View commit details
    Browse the repository at this point in the history
  17. fix limit option

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    99f7115 View commit details
    Browse the repository at this point in the history
  18. remove extra header csv

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    fdf2af0 View commit details
    Browse the repository at this point in the history
  19. match up test with csv

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    b2540aa View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    6b4f7b8 View commit details
    Browse the repository at this point in the history
  21. update results

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    8f8a54f View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    8c19833 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    4c1a267 View commit details
    Browse the repository at this point in the history
  24. update results

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    5e88b53 View commit details
    Browse the repository at this point in the history
  25. update results

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    9c741ae View commit details
    Browse the repository at this point in the history
  26. comment out tests

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    273754e View commit details
    Browse the repository at this point in the history
  27. update test

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    826aca1 View commit details
    Browse the repository at this point in the history
  28. update operator scores

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    8ecf8b8 View commit details
    Browse the repository at this point in the history
  29. cleanup

    tgravescs committed May 19, 2022
    Configuration menu
    Copy the full SHA
    992296c View commit details
    Browse the repository at this point in the history

Commits on May 20, 2022

  1. test sql df times

    tgravescs committed May 20, 2022
    Configuration menu
    Copy the full SHA
    503b42f View commit details
    Browse the repository at this point in the history
  2. Update more to use spark reported df duration

    Signed-off-by: Thomas Graves <tgraves@apache.org>
    tgravescs committed May 20, 2022
    Configuration menu
    Copy the full SHA
    c1b777f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4afa4db View commit details
    Browse the repository at this point in the history
  4. fix task duration

    tgravescs committed May 20, 2022
    Configuration menu
    Copy the full SHA
    0c0d3e5 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    0e32b56 View commit details
    Browse the repository at this point in the history
  6. only use stages used in sql

    tgravescs committed May 20, 2022
    Configuration menu
    Copy the full SHA
    adb26c8 View commit details
    Browse the repository at this point in the history
  7. remove some decimal checks

    tgravescs committed May 20, 2022
    Configuration menu
    Copy the full SHA
    9d85268 View commit details
    Browse the repository at this point in the history
  8. cleanup utils

    tgravescs committed May 20, 2022
    Configuration menu
    Copy the full SHA
    bf135e9 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    67d8e15 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    f78c3f2 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2022

  1. Configuration menu
    Copy the full SHA
    0f0af93 View commit details
    Browse the repository at this point in the history
  2. dedup

    tgravescs committed May 23, 2022
    Configuration menu
    Copy the full SHA
    fe44c45 View commit details
    Browse the repository at this point in the history
  3. fix compil

    tgravescs committed May 23, 2022
    Configuration menu
    Copy the full SHA
    6903cb4 View commit details
    Browse the repository at this point in the history
  4. fix set

    tgravescs committed May 23, 2022
    Configuration menu
    Copy the full SHA
    bd99446 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    f93d289 View commit details
    Browse the repository at this point in the history
  6. update test results

    tgravescs committed May 23, 2022
    Configuration menu
    Copy the full SHA
    8281314 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    3931e80 View commit details
    Browse the repository at this point in the history
  8. fix merge

    tgravescs committed May 23, 2022
    Configuration menu
    Copy the full SHA
    705b2c5 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    bf25347 View commit details
    Browse the repository at this point in the history
  10. fix extra code

    tgravescs committed May 23, 2022
    Configuration menu
    Copy the full SHA
    a9de996 View commit details
    Browse the repository at this point in the history
  11. update csv exepcted results

    tgravescs committed May 23, 2022
    Configuration menu
    Copy the full SHA
    addaa94 View commit details
    Browse the repository at this point in the history
  12. move logging

    tgravescs committed May 23, 2022
    Configuration menu
    Copy the full SHA
    17e26d3 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    6d13c56 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2022

  1. commonize code

    tgravescs committed May 24, 2022
    Configuration menu
    Copy the full SHA
    47522da View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ef473e4 View commit details
    Browse the repository at this point in the history
  3. update latest test results

    tgravescs committed May 24, 2022
    Configuration menu
    Copy the full SHA
    61d8466 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    85ebdf7 View commit details
    Browse the repository at this point in the history
  5. update dsv2 results

    tgravescs committed May 24, 2022
    Configuration menu
    Copy the full SHA
    8e22606 View commit details
    Browse the repository at this point in the history
  6. remove logging

    tgravescs committed May 24, 2022
    Configuration menu
    Copy the full SHA
    cd035c0 View commit details
    Browse the repository at this point in the history
  7. typo

    tgravescs committed May 24, 2022
    Configuration menu
    Copy the full SHA
    69241e3 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    5c9785e View commit details
    Browse the repository at this point in the history
  9. remove unused variable

    tgravescs committed May 24, 2022
    Configuration menu
    Copy the full SHA
    b1bc983 View commit details
    Browse the repository at this point in the history