Skip to content
This repository was archived by the owner on Nov 17, 2023. It is now read-only.

[MXNET-793] Virtualized ARMv7 with Qemu CI integration #13203

Merged
marcoabreu merged 3 commits into from
Nov 12, 2018
Merged

[MXNET-793] Virtualized ARMv7 with Qemu CI integration #13203

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
85effb7
Testing just ndarray, since otherwise we require test refactoring whi…
larroy Nov 9, 2018
6e4ec9c
Add QEMU ARMv7 test stage to CI
larroy Nov 9, 2018
31f224e
test_ndarray fails, so change for test_engine until UT are fixed in ARM
larroy Nov 10, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions Jenkinsfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,10 @@

// mxnet libraries
mx_lib = 'lib/libmxnet.so, lib/libmxnet.a, 3rdparty/dmlc-core/libdmlc.a, 3rdparty/tvm/nnvm/lib/libnnvm.a'

// Python wheels
mx_pip = 'build/*.whl'

// for scala build, need to pass extra libs when run with dist_kvstore
mx_dist_lib = 'lib/libmxnet.so, lib/libmxnet.a, 3rdparty/dmlc-core/libdmlc.a, 3rdparty/tvm/nnvm/lib/libnnvm.a, 3rdparty/ps-lite/build/libps.a, deps/lib/libprotobuf-lite.a, deps/lib/libzmq.a'
// mxnet cmake libraries, in cmake builds we do not produce a libnvvm static library by default.
Expand Down Expand Up @@ -414,6 +418,7 @@ core_logic: {
timeout(time: max_time, unit: 'MINUTES') {
utils.init_git()
utils.docker_run('armv7', 'build_armv7', false)
utils.pack_lib('armv7', mx_pip)
}
}
}
Expand Down Expand Up @@ -941,6 +946,16 @@ core_logic: {
}
}
}
},
'ARMv7 QEMU': {
node(NODE_LINUX_CPU) {
ws('workspace/ut-armv7-qemu') {
timeout(time: max_time, unit: 'MINUTES') {
utils.unpack_and_init('armv7', mx_pip)
sh "ci/build.py --docker-registry ${env.DOCKER_CACHE_REGISTRY} -p test.arm_qemu ./runtime_functions.py run_ut_py3_qemu"
Copy link
Copy Markdown
Contributor

@marcoabreu marcoabreu Nov 9, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to use our docker_run utility instead?

Copy link
Copy Markdown
Contributor Author

@larroy larroy Nov 10, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if you look closely, not ATM. because of the runtime_functions.sh which is hardcoded.

Copy link
Copy Markdown
Contributor

@marcoabreu marcoabreu Nov 10, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, gotcha. We can follow up on that in a separate PR. Can you create an issue so we don't forget it?

}
}
}
}
}

Expand Down
2 changes: 1 addition & 1 deletion ci/docker/qemu/runtime_functions.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ def run_ut_python3_qemu_internal():
logging.info("PIP Installing mxnet/tests/requirements.txt")
check_call(['sudo', 'pip3', 'install', '-r', 'mxnet/tests/requirements.txt'])
logging.info("Running tests in mxnet/tests/python/unittest/")
check_call(['nosetests', '--with-timer', '--with-xunit', '--xunit-file', 'nosetests_unittest.xml', '--verbose', 'mxnet/tests/python/unittest/'])
check_call(['nosetests', '--with-timer', '--with-xunit', '--xunit-file', 'nosetests_unittest.xml', '--verbose', 'mxnet/tests/python/unittest/test_engine.py'])
# Example to run a single unit test:
# check_call(['nosetests', '--with-timer', '--with-xunit', '--xunit-file', 'nosetests_unittest.xml', '--verbose', 'mxnet/tests/python/unittest/test_ndarray.py:test_ndarray_fluent'])

Expand Down