Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] not found: type PoissonDistribution in databricks build #3854

Closed
pxLi opened this issue Oct 19, 2021 · 0 comments · Fixed by #3856
Closed

[BUG] not found: type PoissonDistribution in databricks build #3854

pxLi opened this issue Oct 19, 2021 · 0 comments · Fixed by #3856
Assignees
@res-life
Labels
bug Something isn't working build Related to CI / CD or cleanly building

Comments

@pxLi
Copy link
Collaborator

pxLi commented Oct 19, 2021 •
edited
Loading

Describe the bug
introduced in #3789

failed in both db 7.3 and 8.2 runtime

[2021-10-19T01:39:36.689Z] [ERROR] /home/ubuntu/spark-rapids/sql-plugin/src/main/scala/org/apache/spark/sql/rapids/GpuPoissonSampler.scala:22: object math3 is not a member of package org.apache.commons
[2021-10-19T01:39:36.689Z] [ERROR] import org.apache.commons.math3.distribution.PoissonDistribution
[2021-10-19T01:39:36.689Z] [ERROR]                           ^
[2021-10-19T01:39:36.689Z] [ERROR] /home/ubuntu/spark-rapids/sql-plugin/src/main/scala/org/apache/spark/sql/rapids/GpuPoissonSampler.scala:31: not found: type PoissonDistribution
[2021-10-19T01:39:36.689Z] [ERROR]   private val rng = new PoissonDistribution(if (fraction > 0.0) fraction else 1.0)
[2021-10-19T01:39:36.689Z] [ERROR]                         ^
@pxLi pxLi added bug Something isn't working build Related to CI / CD or cleanly building labels Oct 19, 2021
@res-life res-life mentioned this issue Oct 19, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@res-life res-life

Labels
bug Something isn't working build Related to CI / CD or cleanly building
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix not found: type PoissonDistribution in databricks build [databricks] res-life/spark-rapids
2 participants
@pxLi @res-life