incubator-livy icon indicating copy to clipboard operation
incubator-livy copied to clipboard

[LIVY-853][BUILD] Update travis.yml use latest pip and setuptools to fix build

Open warrenzhu25 opened this issue 3 years ago • 4 comments

What changes were proposed in this pull request?

Build https://travis-ci.com/github/apache/incubator-livy/jobs/498541463 failed due to tests_require in setup.py even for no related change. Stacktrace as below:

Couldn't find index page for 'pytest-runner' (maybe misspelled?)
No local packages or working download links found for pytest-runner
Traceback (most recent call last):
File "setup.py", line 58, in <module>
tests_require=['pytest']
File "/usr/lib/python2.7/distutils/core.py", line 111, in setup
_setup_distribution = dist = klass(attrs)
File "/usr/local/lib/python2.7/dist-packages/setuptools/dist.py", line 318, in _init_
self.fetch_build_eggs(attrs['setup_requires'])
File "/usr/local/lib/python2.7/dist-packages/setuptools/dist.py", line 375, in fetch_build_eggs
replace_conflicting=True,
File "/usr/local/lib/python2.7/dist-packages/pkg_resources/_init_.py", line 851, in resolve
dist = best[req.key] = env.best_match(req, ws, installer)
File "/usr/local/lib/python2.7/dist-packages/pkg_resources/_init_.py", line 1123, in best_match
return self.obtain(req, installer)
File "/usr/local/lib/python2.7/dist-packages/pkg_resources/_init_.py", line 1135, in obtain
return installer(requirement)
File "/usr/local/lib/python2.7/dist-packages/setuptools/dist.py", line 443, in fetch_build_egg
return cmd.easy_install(req)
File "/usr/local/lib/python2.7/dist-packages/setuptools/command/easy_install.py", line 667, in easy_install
raise DistutilsError(msg)
distutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('pytest-runner')

It seems caused by old version of pip and setuptools for python2

How was this patch tested?

Manually tested in build CI.

warrenzhu25 avatar Apr 16 '21 17:04 warrenzhu25

Codecov Report

Merging #318 (57b4b8b) into master (4d8a912) will decrease coverage by 0.01%. The diff coverage is n/a.

Impacted file tree graph

@@             Coverage Diff              @@
##             master     #318      +/-   ##
============================================
- Coverage     68.50%   68.48%   -0.02%     
  Complexity      841      841              
============================================
  Files           103      103              
  Lines          5940     5940              
  Branches        898      898              
============================================
- Hits           4069     4068       -1     
- Misses         1312     1313       +1     
  Partials        559      559              
Impacted Files Coverage Δ Complexity Δ
...ain/scala/org/apache/livy/utils/SparkYarnApp.scala 73.75% <0.00%> (-1.25%) 40.00% <0.00%> (ø%)
...ain/java/org/apache/livy/rsc/driver/RSCDriver.java 80.00% <0.00%> (-0.84%) 45.00% <0.00%> (-1.00%)
...cala/org/apache/livy/scalaapi/ScalaJobHandle.scala 65.11% <0.00%> (+2.32%) 0.00% <0.00%> (ø%)
...in/java/org/apache/livy/rsc/driver/JobWrapper.java 88.57% <0.00%> (+5.71%) 9.00% <0.00%> (+1.00%)

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 4d8a912...57b4b8b. Read the comment docs.

codecov-commenter avatar Apr 19 '21 01:04 codecov-commenter

@jerryshao @mgaido91 Can you please review this?

warrenzhu25 avatar Apr 19 '21 03:04 warrenzhu25

@jerryshao @vanzin you are more familiar than me on this. I see no issues, but I am not familiar with this part.

mgaido91 avatar Oct 14 '21 14:10 mgaido91

Bump on this. It seems like merging this PR will unblock most other open PRs. Can someone please take a look at this?

derache123 avatar May 11 '22 18:05 derache123