Jason Lowe-Power
2018-08-17 17:38:45 UTC
Hey all,
I'm excited to announce that we've finally merged the new testing
infrastructure into the mainline! Big thanks to Sean Wilson for all of the
effort he put in to building it from scratch!
Now, to test to make sure your changes don't break anything unexpectedly,
you can simply run:
cd tests
./main.py run -j<CPUs>
The plan is for this simple interface will test our best supported
platforms and functions. Right now, it builds X86, ARM, and RISC-V, and
runs a couple simple tests (hello for x86 and ARM and m5-exit for x86).
There's also "long" tests which will compile all ISAs. Adding more tests to
both the "quick" and "long" groups is the next step.
More details on how to use the new infrastructure can be found in
TESTING.md (https://gem5.googlesource.com/public/gem5/+/master/TESTING.md).
Quick caveat: There will likely be bugs found in the infrastructure,
especially in the first few weeks of public availability. I'll do my best
to respond and fix ASAP.
Next steps
--------------
My plan is to start porting over more tests from our old infrastructure
going forward. I'm going to start with the simple NULL tests (e.g.,
memtests) and then move on to some "real" applications that stress the CPUs
and ISAs.
Right now, I don't have a timeline for this. While I think it's incredibly
important, I do have a day job ;).
I would *love* some help with all of this. So if anyone is interested in
contributing, please reply to this message!
Testing applications
--------------------------
I'm planning on dropping all of the SPEC tests since they are not easily
distributed. Instead, I'm thinking of using applications from the LLVM test
suite (
https://github.com/llvm-mirror/test-suite/tree/master/SingleSource/Benchmarks).
There's many more applications than we need in there. I'm planning on
cherry picking a few.
I'm open to suggestions for a better source for applications. The LLVM
suite is nice because it's fully open source and used by another project.
If anyone else has suggestions or ideas, please let me know!
TL;DR
---------
1) There may be some bugs. Let us know if you have trouble using the new
tests.
2) More tests are coming. We would *love* help with this!
3) Ideas for new tests are welcome.
Cheers,
Jason
I'm excited to announce that we've finally merged the new testing
infrastructure into the mainline! Big thanks to Sean Wilson for all of the
effort he put in to building it from scratch!
Now, to test to make sure your changes don't break anything unexpectedly,
you can simply run:
cd tests
./main.py run -j<CPUs>
The plan is for this simple interface will test our best supported
platforms and functions. Right now, it builds X86, ARM, and RISC-V, and
runs a couple simple tests (hello for x86 and ARM and m5-exit for x86).
There's also "long" tests which will compile all ISAs. Adding more tests to
both the "quick" and "long" groups is the next step.
More details on how to use the new infrastructure can be found in
TESTING.md (https://gem5.googlesource.com/public/gem5/+/master/TESTING.md).
Quick caveat: There will likely be bugs found in the infrastructure,
especially in the first few weeks of public availability. I'll do my best
to respond and fix ASAP.
Next steps
--------------
My plan is to start porting over more tests from our old infrastructure
going forward. I'm going to start with the simple NULL tests (e.g.,
memtests) and then move on to some "real" applications that stress the CPUs
and ISAs.
Right now, I don't have a timeline for this. While I think it's incredibly
important, I do have a day job ;).
I would *love* some help with all of this. So if anyone is interested in
contributing, please reply to this message!
Testing applications
--------------------------
I'm planning on dropping all of the SPEC tests since they are not easily
distributed. Instead, I'm thinking of using applications from the LLVM test
suite (
https://github.com/llvm-mirror/test-suite/tree/master/SingleSource/Benchmarks).
There's many more applications than we need in there. I'm planning on
cherry picking a few.
I'm open to suggestions for a better source for applications. The LLVM
suite is nice because it's fully open source and used by another project.
If anyone else has suggestions or ideas, please let me know!
TL;DR
---------
1) There may be some bugs. Let us know if you have trouble using the new
tests.
2) More tests are coming. We would *love* help with this!
3) Ideas for new tests are welcome.
Cheers,
Jason