我们正在考虑集中cfg信息,看起来动物园管理员是一个不错的选择。我们也对分片感兴趣,并有一个计划。在poweredBy[1]中看到Rackspace和雅虎正在使用Zookeeper进行分片。如有指示和细节,不胜感激。
[1] https://cwiki.apache.org/confluence/display/ZOOKEEPER/PoweredBy
我们正在考虑集中cfg信息,看起来动物园管理员是一个不错的选择。我们也对分片感兴趣,并有一个计划。在poweredBy[1]中看到Rackspace和雅虎正在使用Zookeeper进行分片。如有指示和细节,不胜感激。
[1] https://cwiki.apache.org/confluence/display/ZOOKEEPER/PoweredBy
Solr将使用Zookeeper进行分片ZooKeeper Integration设计文档可能会让你感兴趣。
我能想到他们可以参考的两件事。
他们可以使用内置的集成功能进行参考。使用这些,您实际上可以为您的服务设置组管理协议。当你在集合中添加更多的服务器时,你可以有效地将你的池分成更多的数量。集合的成员之间的数据在成员服务器之间同步。这对于将同一数据集分片到多个读池的应用程序尤其有用,例如索引服务器、搜索服务器、读缓存等。
他们可能正在使用ZooKeeper进行配置管理。现在让我们假设您的应用程序可能有数千个客户端,它们都需要同时更新配置文件。假设您的应用程序现在访问一个由50台服务器组成的数据存储层,但该池需要分片到200台。您可以设置从属关系来执行1到4的从属关系。ZooKeeper可以用来更新配置文件,本质上可以在一秒钟内更改每个配置文件。
你还应该看看HBase是如何使用Zookeeper的;特别是维护关于区域的信息。这类似于使用ZK来维护DB分片信息。
For managing the lookup table . Since this lookup table have to be strong consistent, this is where zookeeper comes into picture.
Say I have a "message" table with 2 secondary indexes: "recipient_id" "sender_id" I want to shard the "message" table by "recipient_id". That way to retrieve all messages sent to a certain recipient ...
When performing many inserts into a database I would usually have code like this: using (var connection = new SqlConnection(connStr)) { connection.Open(); foreach (var item in items) { var ...
Does anyone have any good sources of information of using NHibernate with Sql Azure with the implications of sharding (because of the 10gb cap)? I know there are posts on the internet that reference a ...
I have a problem where I need to assemble a Map whose eventual size is in the GBs (going on past 64GB) and I cannot assume that a user of the program will have this kind of monster machine hanging ...
Predis claim to have Client-side sharding (support for consistent hashing of keys). http://github.com/nrk/predis I can do sharding using connect to an array of profiles (nodes) but it isn t ...
I m trying to run a sample program for hibernate shards. I m all done with it but whenever I run the test program I get an Exception javax.naming.NoInitialContextException: Need to specify class ...
I m new to both memcached & sharding. I gone though some articles on both. I need to implement both in my application. Articles I d gone through were good but none of them gave me how to use ...
Looking to shard a database and to assign different users to different home servers based on their user id. User IDs are 10 character strings, e.g., "f4gKUKkj91" ... each server has an ID of 1 - 1000....