research-article

On the composability of the Riak DT map: expanding from embedded to multi-key structures

Author:

Christopher MeiklejohnAuthors Info & Claims

PaPEC '14: Proceedings of the First Workshop on Principles and Practice of Eventual Consistency

Article No.: 13, Pages 1 - 2

https://doi.org/10.1145/2596631.2596635

Published: 13 April 2014 Publication History

Get Access

Abstract

The Riak DT library [2] provides a composable, convergent replicated dictionary called the Riak DT map, designed for use in the Riak [1] replicated data store. This data type provides the ability for the composition of conflict-free replicated data types (CRDT) [7] through embedding.

Composition by embedding works well when the total object size of the composed CRDTs is small, however suffers a performance penalty as object size increases. The root of this problem is based in how replication is achieved in the Riak data store using Erlang distribution. [4]

We propose a solution for providing an alternative composition mechanism, composition by reference, which provides support for arbitrarily large objects while ensuring predictable performance and high availability. We explore the use of this new composition mechanism by examining a common use case for the Riak data store.

References

[1]

Basho Technologies, Inc. Riak source code repository. https://github.com/basho/riak,.

Google Scholar

[2]

Basho Technologies, Inc. Riak DT source code repository. https://github.com/basho/riak_dt,.

Google Scholar

[3]

J. Blomstedt. Absolute consistency. http://lists.basho.com/pipermail/riak-users_lists.basho.com/2012-January/007157.html.

Google Scholar

[4]

Boundary. Incuriosity Killed the Infrastructure: Getting Ahead of Riak Performance and Operations. http://boundary.com/blog/2012/09/26/incuriosity-killed-the-infrastructur/.

Google Scholar

[5]

C. Hale and R. Kennedy. Riak and Scala at Yammer. http://vimeo.com/21598799.

Google Scholar

[6]

W. Moss and T. Douglas. Building A Transaction Logs-based Protocol On Riak. http://vimeo.com/53550624.

Google Scholar

[7]

M. Shapiro, N. Preguiça, C. Baquero, and M. Zawirski. A comprehensive study of Convergent and Commutative Replicated Data Types. Rapport de recherche RR-7506, INRIA, Jan. 2011. URL http://hal.inria.fr/inria-00555588.

Google Scholar

Cited By

View all

Larsson LGustafsson HKlein CElmroth E(2020)Decentralized Kubernetes Federation Control Plane2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)10.1109/UCC48980.2020.00056(354-359)Online publication date: Dec-2020
https://doi.org/10.1109/UCC48980.2020.00056
Meiklejohn CVan Roy PFalaschi MAlbert E(2015)LaspProceedings of the 17th International Symposium on Principles and Practice of Declarative Programming10.1145/2790449.2790525(184-195)Online publication date: 14-Jul-2015
https://dl.acm.org/doi/10.1145/2790449.2790525
Meiklejohn CVan Roy PBaquero CSerafini M(2015)LaspProceedings of the First Workshop on Principles and Practice of Consistency for Distributed Data10.1145/2745947.2745954(1-4)Online publication date: 21-Apr-2015
https://dl.acm.org/doi/10.1145/2745947.2745954

Index Terms

On the composability of the Riak DT map: expanding from embedded to multi-key structures

Recommendations

Lasp: a language for distributed, coordination-free programming
PPDP '15: Proceedings of the 17th International Symposium on Principles and Practice of Declarative Programming

We propose Lasp, a new programming model designed to simplify large-scale distributed programming. Lasp combines ideas from deterministic dataflow programming together with conflict-free replicated data types (CRDTs). This provides support for ...
Riak DT map: a composable, convergent replicated dictionary
PaPEC '14: Proceedings of the First Workshop on Principles and Practice of Eventual Consistency

Conflict-Free Replicated Data-Types (CRDTs) [6] provide greater safety properties to eventually-consistent distributed systems without requiring synchronization. CRDTs ensure that concurrent, uncoordinated updates have deterministic outcomes via the ...
Riak PG: distributed process groups on dynamo-style distributed storage
Erlang '13: Proceedings of the twelfth ACM SIGPLAN workshop on Erlang

We present Riak PG, a new Erlang process group registry for highly available applications. The Riak PG system is a Dynamo-based, distributed, fault-tolerant, named process group registry for use as an alternative to the built-in Erlang process group ...

Comments

Information & Contributors

Information

Published In

PaPEC '14: Proceedings of the First Workshop on Principles and Practice of Eventual Consistency

April 2014

47 pages

ISBN:9781450327169

DOI:10.1145/2596631

Program Chair:
Marc Shapiro
INRIA, LIP6

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Seventh Framework Programme

Conference

EuroSys 2014

Sponsor:

SIGOPS

EuroSys 2014: Ninth Eurosys Conference 2014

April 13, 2014

Amsterdam, The Netherlands

Acceptance Rates

PaPEC '14 Paper Acceptance Rate 16 of 20 submissions, 80%;

Overall Acceptance Rate 16 of 20 submissions, 80%

Upcoming Conference

EuroSys '25

Sponsor:
sigops

Twentieth European Conference on Computer Systems

March 30 - April 3, 2025

Rotterdam , Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
202
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Larsson LGustafsson HKlein CElmroth E(2020)Decentralized Kubernetes Federation Control Plane2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)10.1109/UCC48980.2020.00056(354-359)Online publication date: Dec-2020
https://doi.org/10.1109/UCC48980.2020.00056
Meiklejohn CVan Roy PFalaschi MAlbert E(2015)LaspProceedings of the 17th International Symposium on Principles and Practice of Declarative Programming10.1145/2790449.2790525(184-195)Online publication date: 14-Jul-2015
https://dl.acm.org/doi/10.1145/2790449.2790525
Meiklejohn CVan Roy PBaquero CSerafini M(2015)LaspProceedings of the First Workshop on Principles and Practice of Consistency for Distributed Data10.1145/2745947.2745954(1-4)Online publication date: 21-Apr-2015
https://dl.acm.org/doi/10.1145/2745947.2745954

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Lasp: a language for distributed, coordination-free programming

Riak DT map: a composable, convergent replicated dictionary

Riak PG: distributed process groups on dynamo-style distributed storage