English 中文(简体)
Apache Zookeeper是如何在分片中使用的?
原标题:How is Apache Zookeeper used in sharding?

我们正在考虑集中cfg信息,看起来动物园管理员是一个不错的选择。我们也对分片感兴趣,并有一个计划。在poweredBy[1]中看到Rackspace和雅虎正在使用Zookeeper进行分片。如有指示和细节,不胜感激。

[1] https://cwiki.apache.org/confluence/display/ZOOKEEPER/PoweredBy

问题回答

Solr将使用Zookeeper进行分片ZooKeeper Integration设计文档可能会让你感兴趣。

我能想到他们可以参考的两件事。

  1. 他们可以使用内置的集成功能进行参考。使用这些,您实际上可以为您的服务设置组管理协议。当你在集合中添加更多的服务器时,你可以有效地将你的池分成更多的数量。集合的成员之间的数据在成员服务器之间同步。这对于将同一数据集分片到多个读池的应用程序尤其有用,例如索引服务器、搜索服务器、读缓存等。

  2. 他们可能正在使用ZooKeeper进行配置管理。现在让我们假设您的应用程序可能有数千个客户端,它们都需要同时更新配置文件。假设您的应用程序现在访问一个由50台服务器组成的数据存储层,但该池需要分片到200台。您可以设置从属关系来执行1到4的从属关系。ZooKeeper可以用来更新配置文件,本质上可以在一秒钟内更改每个配置文件。

你还应该看看HBase是如何使用Zookeeper的;特别是维护关于区域的信息。这类似于使用ZK来维护DB分片信息。

For managing the lookup table . Since this lookup table have to be strong consistent, this is where zookeeper comes into picture.





相关问题
Is it OK to re-create many SQL connections (SQL 2008)

When performing many inserts into a database I would usually have code like this: using (var connection = new SqlConnection(connStr)) { connection.Open(); foreach (var item in items) { var ...

NHibernate with Sql Azure and Sharding

Does anyone have any good sources of information of using NHibernate with Sql Azure with the implications of sharding (because of the 10gb cap)? I know there are posts on the internet that reference a ...

Automatically Sharding a Java Map across multiple nodes

I have a problem where I need to assemble a Map whose eventual size is in the GBs (going on past 64GB) and I cannot assume that a user of the program will have this kind of monster machine hanging ...

Predis sharding (consistent hashing)

Predis claim to have Client-side sharding (support for consistent hashing of keys). http://github.com/nrk/predis I can do sharding using connect to an array of profiles (nodes) but it isn t ...

Problem with Hibernate Shards & JNDI

I m trying to run a sample program for hibernate shards. I m all done with it but whenever I run the test program I get an Exception javax.naming.NoInitialContextException: Need to specify class ...

Memcached and Sharding

I m new to both memcached & sharding. I gone though some articles on both. I need to implement both in my application. Articles I d gone through were good but none of them gave me how to use ...

Assign 10-digit char user ids to 1 of 1000 servers

Looking to shard a database and to assign different users to different home servers based on their user id. User IDs are 10 character strings, e.g., "f4gKUKkj91" ... each server has an ID of 1 - 1000....

热门标签