Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP][Ansor][AutoTVM v2.0] Part 0: Infrastructures for Automatic Schedule Search #5883

Closed
wants to merge 45 commits into from
Closed

[WIP][Ansor][AutoTVM v2.0] Part 0: Infrastructures for Automatic Schedule Search #5883

wants to merge 45 commits into from

Commits on Jun 20, 2020

  1. Code migration Start (#1) 

    * Init commit: Code migration Start

* Add loop_state.cc/h

* Add ComputeDAG basic test
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    7ee0902 View commit details
    Browse the repository at this point in the history

  2. Split transform_step out & Update more UTs (apache#3) 

    * Split transform_step out

* Update GetProducers & GetConsumers

* Update UTs

* Add UT for CacheReadWrite & Some bug fix
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    9fcbf0b View commit details
    Browse the repository at this point in the history

  3. Add search_task, measure and serialization (apache#4) 

    * Add FollowSplit & FollowFusedSplit tests

* Update dag.InferBound & its UT

* Add search_task, measure and serialization

* Update Serialization UT
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    f43e82f View commit details
    Browse the repository at this point in the history

  4. Add MetaTileRewritePolicy (apache#5) 

    * Add feature

* Add cost_model, meta_tile_rewrite_policy

* Add MetaTileRewritePolicy basic UT
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    e0a5ed5 View commit details
    Browse the repository at this point in the history

  5. Basic Python API for State (apache#6) 

    * Add Basic Python API for State

* Add UTs for State
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    359905a View commit details
    Browse the repository at this point in the history

  6. Add Python API: Measure & Task (apache#7) 

    * Update the return value of state operation

* Add task

* Copy measure.py & utils.py

* Fix LocalBuilder

* Fix LocalRunner
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    2032a64 View commit details
    Browse the repository at this point in the history

  7. Add ansor.auto_schedule() API; First AutoSchedule working version(apa… 

    …che#8)

* Add basic Python support for ansor.auto_schedule

* Update AutoSchedule API

* Bug fix for get the attach point of a fused iter

* Update UT after infer bug fix
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    6b21dc6 View commit details
    Browse the repository at this point in the history

  8. Bug fix & Add python serialization API (apache#10) 

    * Delete C++ UT hack since Python is ready

* Add ndarray.non_empty

* Update Serialization python API
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    e52135f View commit details
    Browse the repository at this point in the history

  9. Improve code style, python wrapper and test cases (apache#11) 

    * Update c++ code style and unit test

* Update python State wrapper and test cases
    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    1fe6638 View commit details
    Browse the repository at this point in the history

  10. fix unit tests

    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    43d1530 View commit details
    Browse the repository at this point in the history

  11. Add RPCRunner & OpenCL/CUDA test (apache#12) 

    * Add RPCRunner & OpenCL search test

* Add CUDA search test

* Add RPCRunner test
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    f367d15 View commit details
    Browse the repository at this point in the history

  12. rebase to upstream/master

    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    2bd6471 View commit details
    Browse the repository at this point in the history

  13. Add Ansor basic tutorial (apache#13) 

    * Add basic tutorial
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    c860f2c View commit details
    Browse the repository at this point in the history

  14. migrate feature extraction (apache#14)

    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    f60d1a6 View commit details
    Browse the repository at this point in the history

  15. Add XGBModel & RPCRunnerWarpper (apache#15) 

    * Add XGBModel & RPCRunnerWarpper

* Revert "Add Parallel Granularity Mutation"
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    b839c0f View commit details
    Browse the repository at this point in the history

  16. Migrate workload_registry.py (apache#16) 

    * add workload registry

* update

* update
    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    cfe58d7 View commit details
    Browse the repository at this point in the history

  17. add task scheduler (apache#17)

    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    143ea45 View commit details
    Browse the repository at this point in the history

  18. Add conv2d cuda tutorial with workload registry (apache#18)

    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    ed075c2 View commit details
    Browse the repository at this point in the history

  19. add tune_test.py (the old tune_wkl.py) (apache#19) 

    * add tune_test.py (the old tune_wkl.py)

* update

* fix measure

* fix for gpu
    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    74ec7d0 View commit details
    Browse the repository at this point in the history

  20. Code refine for tune_test.py & Add a pre load callback (apache#20) 

    * Bug fix for tutorials

* Add PreLoadMeasuredStates

* Add search_callback support for task tuner

* Code refine for tune_test.py

* Update

* Update

* Update

* Update

* Bug fix
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    cd0a516 View commit details
    Browse the repository at this point in the history

  21. Add python custom sketch rule (apache#21) 

    * Add custom sketch rule

* Bug fix
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    3a24e49 View commit details
    Browse the repository at this point in the history

  22. Ansor Relay Integration (without layout rewrite) (apache#22) 

    * relay integration
    @minminsun @merrymercy
    minminsun authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    a155c1f View commit details
    Browse the repository at this point in the history

  23. Add tune_op_subgraph.py & Some code clean for tune_network.py (apache#23 

    )

* Add single op tune scripts

* Add tune subgraph support

* Merge all op & all subgraph to one file

* Rename file
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    674027f View commit details
    Browse the repository at this point in the history

  24. add explicit_unroll_max_extent (apache#25)

    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    2f241ed View commit details
    Browse the repository at this point in the history

  25. Add Index simplification & API update (apache#26) 

    * Add vectorized cooperative_fetching test

* Update math simplify for vectorized CF

* File rename

* Update tune_network

* API update
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    18d44b8 View commit details
    Browse the repository at this point in the history

  26. Update PreLoadMeasuredStates & Some bug fix (apache#27) 

    * Add a threading wrapper to fix the test bug

* Set default TVM_USE_AUTO_SCHEDULER to false

* Update PreLoadMeasuredStates callback
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    4ea6712 View commit details
    Browse the repository at this point in the history

  27. Add tensorize step for loop_state (apache#31) 

    * Add tensorize step
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    6126cdb View commit details
    Browse the repository at this point in the history

  28. State python api update (apache#33) 

    * Start to update api

* Add compute_dag to state

* API update
    @jcf94 @merrymercy
    jcf94 authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    c7364df View commit details
    Browse the repository at this point in the history

  29. kernel layout rewrite (apache#28) 

    * kernel layout rewrite

* remove some hacks

* add defuse_ops pass and move kernel_layout_rewrite pass after fuse_ops pass

* set TVM_RELAY_DISABLE_BUILD_CACHE for task extraction and prepare_layout_rewrite
    @minminsun @merrymercy
    minminsun authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    36cd9ef View commit details
    Browse the repository at this point in the history

  30. [cache flush] port cache flush to ansor (apache#32)

    @FrozenGene @merrymercy
    FrozenGene authored and merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    145e61c View commit details
    Browse the repository at this point in the history

  31. Improve relay integration (apache#34) 

    * tmp checkpoint

* Improve relay integration

* Improve relay integration
    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    2c27816 View commit details
    Browse the repository at this point in the history

  32. Fix xgb error & Simplify dispatcher (apache#35)

    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    0794875 View commit details
    Browse the repository at this point in the history

  33. Rename "MetaTileRewritePolicy" to "SketchPolicy". (apache#36) 

    * Rename "MetaTileRewritePolicy" to "SketchPolicy".

* Add a new class for auto_unroll_max_step, storage_offset in StageNode

* fix tune_op_subgraph.py
    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    a4c4548 View commit details
    Browse the repository at this point in the history

  34. rebase

    @merrymercy
    merrymercy committed Jun 20, 2020
    Configuration menu
    Copy the full SHA
    593a2c7 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2020

  1. Migrate all node::make to noderef's construct function (apache#37) 

    * Start to move xxxnode::make to noderef()

* Update

* Update

* Finish transform_step

* Finish comute dag & auto schedule

* Update

* Update

* Update

* Update

* Update

* Code refine

* Code refine

* Code refine

* Update

* Update
    @jcf94
    jcf94 committed Jun 22, 2020
    Configuration menu
    Copy the full SHA
    53bd591 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2020

  1. Some lint fix & Recover the double constructor of tvm::PrimExpr (apac… 

    …he#39)

* lint fix

* clang-format-fix

* pylint fix

* Update

* Recover the double constructor of tvm::PrimExpr

* Fix pylint

* pylint fix

* pylint fix
    @jcf94
    jcf94 committed Jun 23, 2020
    Configuration menu
    Copy the full SHA
    8e53d12 View commit details
    Browse the repository at this point in the history

  2. Add MutateComputeLocation and MutateParallel in evolutionary search (a… 

    …pache#40)

* Add MutateComputeLocation and MutateParallel in evolutionary search

* fix lint
    @merrymercy
    merrymercy committed Jun 23, 2020
    Configuration menu
    Copy the full SHA
    cd5c5ad View commit details
    Browse the repository at this point in the history

  3. Improve loop state python API (stage_tensors -> stage_ops) (apache#41) 

    * improve loop state python API (stage_tensors -> stage_ops)

* fix
    @merrymercy
    merrymercy committed Jun 23, 2020
    Configuration menu
    Copy the full SHA
    5860191 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2020

  1. ComputeDAG bug fix & Add Custom TensorCore Matmul Example (apache#42) 

    * Bug Fix

* Sample example of Custom TensorCore Matmul
    @jcf94
    jcf94 committed Jun 24, 2020
    Configuration menu
    Copy the full SHA
    14a19cd View commit details
    Browse the repository at this point in the history

  2. Revert commit

    @jcf94
    jcf94 committed Jun 24, 2020
    Configuration menu
    Copy the full SHA
    59c88d1 View commit details
    Browse the repository at this point in the history

  3. Revert commits

    @jcf94
    jcf94 committed Jun 24, 2020
    Configuration menu
    Copy the full SHA
    86bfd8f View commit details
    Browse the repository at this point in the history

  4. Rever Commits, Start to build minimum Ansor system

    @jcf94
    jcf94 committed Jun 24, 2020
    Configuration menu
    Copy the full SHA
    910964e View commit details
    Browse the repository at this point in the history

  5. Code clean for minimum Ansor system

    @jcf94
    jcf94 committed Jun 24, 2020
    Configuration menu
    Copy the full SHA
    d567617 View commit details
    Browse the repository at this point in the history

  6. UT ready

    @jcf94
    jcf94 committed Jun 24, 2020
    Configuration menu
    Copy the full SHA
    a8e589e View commit details
    Browse the repository at this point in the history

  7. Update

    @jcf94
    jcf94 committed Jun 24, 2020
    Configuration menu
    Copy the full SHA
    2456c3e View commit details
    Browse the repository at this point in the history