Shark (Hive on Spark)

Shark(Hive on Spark)。Shark的开发已经结束。【Shark (Hive on Spark)。Development in Shark has been ended.】

  • Owner: amplab/shark
  • Platform: BSD, Cross-platform, Linux, Mac, Solaris, Unix-like, Windows
  • License:: Apache License 2.0
  • Category::
  • Topic:
  • Like:
    0
      Compare:

Github stars Tracking Chart

Shark (Hive on Spark)

Shark的开发已经结束, 并被 Spark SQL 纳入其中。有关详细信息, 请参阅此博客文章

Shark构建在Hive代码库上,通过交换Hive的物理执行引擎部分来实现性能改进。虽然这种方法使Shark用户能够加速他们的Hive查询,但是Shark从Hive继承了一个庞大而复杂的代码库,这使得很难进行优化和维护。当我们开始推动性能优化的边界并将复杂的分析与SQL集成时,我们受到为MapReduce设计的遗留问题的限制。

正是出于这个原因,我们将Shark中的开发作为一个单独的项目结束,并将所有开发资源转移到Spark SQL,这是Spark中的一个新组件。我们正在将我们在Shark中学到的知识应用到Spark SQL中,它是从头开始设计的,以充分利用Spark的强大功能。这种新方法使我们能够更快地进行创新,并最终为用户提供更好的体验和能力。


Overview

Name With Owneramplab/shark
Primary LanguageScala
Program languageShell (Language Count: 5)
PlatformBSD, Cross-platform, Linux, Mac, Solaris, Unix-like, Windows
License:Apache License 2.0
Release Count10
Last Release Namev0.9.3 (Posted on )
First Release Namev0.2.0 (Posted on 2012-10-15 15:28:12)
Created At2012-04-14 09:39:53
Pushed At2015-08-11 10:52:52
Last Commit At2014-10-01 21:35:31
Stargazers Count1k
Watchers Count200
Fork Count328
Commits Count1.3k
Has Issues Enabled
Issues Count0
Issue Open Count0
Pull Requests Count230
Pull Requests Open Count12
Pull Requests Close Count59
Has Wiki Enabled
Is Archived
Is Fork
Is Locked
Is Mirror
Is Private

Shark (Hive on Spark)

Development in Shark has been ended and subsumed by Spark SQL. Please see this blog post for more information.

To the top