Event Queue Dialect
Event queue (Equeue) dialect is an MLIR Dialect that models concurrent devices in terms of control and structure.
Motivation
The main motivation of the event queue dialect is to efficiently estimate performance of programs running on heterogenous accelerators. The dialect is designed to bridge the gap between low-level hardware specific dialects and high-level dialects with little hardware specific information, thus facilitating custom lowering among different design choices. In particular, the EventQueue dialect supports modeling memory size constraints, bandwidth constraints, and processing time across a large number of heterogenous processors with distributed event-based control.
By and large, event queue dialect is design to estimate performance of concurrent devices. It supports:
-
Arbitrary hardware hierarchy and each hardware with its own properties.
-
Modeling data movement and buffer allocation that is critical to energy and efficiency estimation.
-
Model concurrency between heterogenous devices.
Check further documentation to see how the goals are achieved.
EQueue Dialect in MLIR Lowering Pipeline
Event queue dialect is designed to do performance analysis.
Because there is a gap between high level dialect that has no structure information, and low level dialect that is too detail to analyze, event queue dialect bridges them.
The input for the event queue dialect is high level control dialect without structure and the output will be dialect describing detailed structure information.
In the lowering pipeline, equeue dialect is at the same level as gpu dialect. The difference is that existing gpu dialect assumes a synchronous gpu model and try to communicate with gpu.barrier among concurrent gpus, while equeue dialect models a more general design, where it allows any kinds of structure, thus allowing maximum flexibility. To describe the complexity of any possible structure in a flexible device like FPGA, equeue dialect develops a general semantics for asynchronous communication between concurrent devices.
How to Use
Dependency
The dependency of this project is MLIR. Because MLIR is project that frequently being updated. When I started the EQueue project, The latest stable version was 12-init. One needs checkout to the right version.
git clone https://github.com/llvm/llvm-project.git
git fetch --all --tags
git checkout tags/llvmorg-12-init -b
and then follow MLIR quick start to build executable.
Quick Start
After git clone and cd the repo,
mkdir build
cp *.sh build/
cd build
#change LLVM_EXTERNAL_LIT and MLIR_DIR in run.sh to your local directory
sh config; sh run.sh
./bin/equeue-opt ../test/Equeue/[path-to-input-file.mlir]
Debug Outputs
If one want to turn on debug outputs with -debug or debug-only when there are multiple debugging options
./bin/equeue-opt ../test/Equeue/[path-to-input-file.mlir] -debug
# when there are multiple debugging options
./bin/equeue-opt ../test/Equeue/[path-to-input-file.mlir] -debug-only=command_processor
# to redirect output to file
./bin/equeue-opt ../test/Equeue/[path-to-input-file.mlir] -debug > & report
Visualization
By default equeue-opt will generate a Trace Event Format JSON file to test/Equeue/out.json . You can specify the output file name with -json
./bin/equeue-opt ../test/Equeue/[path-to-input-file.mlir] -json [path-to-json-file.json]
The output JSON file can be viewed in chrome://tracing/
Below is the visualization of running test/EQueue/gpu.mlir
Examples
You may want to check on Examples on the convolution and the finite impulse response. Detailed explanation can be found in the example directory
Paper and Citation
The paper is accepted to HPCA 2022. We upload a preprint to Arxiv.
Contact
I am Zhijing at Cornell University. This project is originally my Xilinx internship project. I extend after the internship and now it is accepted by HPCA 2022. I will put the reference later. If getting to any trouble, you can contact me at [email protected]
1.3k Jan 2, 2023
157 Dec 11, 2022
19 Dec 10, 2022
13 Dec 23, 2022
46 Dec 15, 2022
39 Nov 22, 2022
15 Jan 1, 2023
2.2k Jan 3, 2023
33 Dec 2, 2022
![[Config Failed] The dependency target](https://avatars.githubusercontent.com/u/34334180?v=4)
213 Dec 27, 2022
47 Nov 22, 2022
4 Feb 15, 2022
153 Jan 7, 2023
14 Oct 21, 2022
20 Dec 31, 2021
117 Jan 7, 2023
1 Jan 19, 2022
1 Nov 4, 2022
1 Jan 12, 2022