Results 241 to 250 of about 862,924 (286)

Research of Distributed Data Store Based on HDFS

2013 International Conference on Computational and Information Sciences, 2013
This paper analyzes the advantages and disadvantages of the traditional HDFS cluster architecture. An application framework designed for the small and medium-sized HDFS clusters is proposed in this paper to make up for incomplete HDFS application architecture, difficulties on deploying, inefficiency on I/O processing of small files.
Xin Wang, Jianhua Su
openaire   +1 more source

Distributed Store for Ontology Data Management

2012
The Semantic Web is recognized as the next generation web which aims at the automation, integration and reuse of data across different internet applications. To better understand and utilize the Semantic Web, the W3C adopted standards and tools such as the Resource Description Framework (RDF) and Web Ontology Language (OWL). Management of large amounts
Abdullah Alamri, Peter Bertok
openaire   +1 more source

Preparing, storing, and distributing multi-dimensional scientific data

2015 IEEE International Conference on Big Data (Big Data), 2015
Data of all sizes, generated by simulation and observation (i.e., instruments and satellites) activities, should be collected, stored, and organized, along with associated tools and research results, so that they are easily discoverable and accessible.
Ranjeet Devarakonda, Yaxing Wei, Michele Thornton, Ben Mayer, Peter Thornton, Bob Cook   +5 more
openaire   +1 more source

Towards a cost model for distributed and replicated data stores

Proceedings Ninth Euromicro Workshop on Parallel and Distributed Processing, 2002
Large, Petabyte-scale data stores need detailed design considerations about distributing and replicating particular parts of the data store in a cost-effective way. Technical issues need to be analysed and, based on these constraints, an optimisation problem can be formulated.
Stockinger, Heinz, Stockinger, Kurt, Schikuta, Erich, Willers, Ian   +3 more
openaire   +1 more source

Data adaptively storing approach for hadoop distributed file system

2017 2nd IEEE International Conference on Computational Intelligence and Applications (ICCIA), 2017
Hadoop distributed file system (HDFS) is an open source framework that has been usually used for cloud storage systems. Due to the arts and craft development and the consideration of price, today's storage system usually contains both fast devices (such as SSDs) and slow devices (like Hard disks).
Yingxun Fu, Shilin Wen, Li Ma
openaire   +1 more source

SHC: Distributed Query Processing for Non-Relational Data Store

2018 IEEE 34th International Conference on Data Engineering (ICDE), 2018
We introduce a simple data model to process non-relational data for relational operations, and SHC (Apache Spark - Apache HBase Connector), an implementation of this model in the cluster computing framework, Spark. SHC leverages optimization techniques of relational data processing over the distributed and column-oriented key-value store (i.e., HBase).
Weiqing Yang, Mingjie Tang, Yongyang Yu, Yanbo Liang, Bikas Saha   +4 more
openaire   +1 more source

DBalancer

Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, 2013
Unanticipated load spikes or skewed data access patterns may lead to severe performance degradation in data serving applications, a typical problem of distributed NoSQL data-stores. In these cases, load balancing is a necessary operation. In this demonstration, we present the DBalancer, a generic distributed module that can be installed on top of a ...
Konstantinou I., Tsoumakos D., Mytilinis I., Koziris N.   +3 more
openaire   +1 more source

Development of distributed file system for storing weather data

SPIE Proceedings, 2016
This article presents the results of developing a software for surface meteorological observation network storage. Multithreading was used to simulate a distributed cluster of information-computational resources during the software testing. This technology is used to create concurrently executing threads and is supported by practically every operating ...
V. S. Sherstnev, I. A. Botygin, A. S. Zenzin, A. I. Sherstneva, N. Y. Galanova   +4 more
openaire   +1 more source

An Error-Reflective Consistency Model for Distributed Data Stores

2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2019
Consistency models for distributed data stores offer insights and paths to reasoning about what a user of such a system can expect. However, often consistency models are defined or implemented in coarse-grained manners, making it difficult to achieve precisely the consistency required.
Philip Dexter, Kenneth Chiu, Bedri Sendir   +2 more
openaire   +1 more source

Omid: Lock-free transactional support for distributed data stores

2014 IEEE 30th International Conference on Data Engineering, 2014
In this paper, we introduce Omid, a tool for lock-free transactional support in large data stores such as HBase. Omid uses a centralized scheme and implements snapshot isolation, a property that guarantees that all read operations of a transaction are performed on a consistent snapshot of the data.
Daniel Gomez Ferro, Flavio Junqueira, Ivan Kelly, Benjamin Reed, Maysam Yabandeh   +4 more
openaire   +1 more source