Method and system to select data nodes configured to satisfy a set of requirements

A data node, data technology, applied in transmission systems, electrical digital data processing, resource allocation, etc., can solve the problem of not being able to support in a transparent way.

Active Publication Date: 2014-04-16
IBM CORP
View PDF2 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Hadoop-based systems provide decentralized file system performance with a decentralized architecture to achieve business resilience despite the fact that entire racks of servers and storage systems are unavailable due to loss of network connectivity, hardware failure, or catastrophic failure ( resiliency), but Hadoop solutions (and distributed computing solutions in general) also cannot transparently support policy-driven service level agreements for external consumers

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system to select data nodes configured to satisfy a set of requirements
  • Method and system to select data nodes configured to satisfy a set of requirements
  • Method and system to select data nodes configured to satisfy a set of requirements

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] Embodiments generally provide techniques for enabling selection of data nodes configured to meet a set of requirements for processing customer data in a distributed computing environment. For each data node of a plurality of data nodes in a distributed computing environment, embodiments may provide node data describing individual data nodes of the plurality of data nodes. A request to process customer data may be received, the customer data being identified in the request. Additionally, these embodiments may retrieve the set of requirements for processing customer data identified in the request, and may analyze the retrieved data policy and node data describing at least one data node to select the The first data node among the plurality of data nodes serves as a delegation target. Accordingly, the first data node is selected based on its suitability to satisfy the set of requirements more than the second data node of the plurality of data nodes.

[0014] Although vari...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Method, system, and computer program product to select data nodes configured to satisfy a set of requirements for processing client data in a distributed computing environment by providing, for each data node of a plurality of data nodes in the distributed computing environment, nodal data describing the respective data node of the plurality of data nodes, receiving a request to process the client data, the client data being identified in the request, retrieving the set of requirements for processing the client data, and analyzing the retrieved data policy and the nodal data describing at least one of the data nodes, to select a first data node of the plurality of data nodes as a delegation target, the first data node selected based on having a higher suitability level for satisfying the set of requirements than a second data node of the plurality of data nodes.

Description

technical field [0001] Embodiments disclosed herein relate to computer software that transparently implements policies in a distributed processing architecture. Background technique [0002] Now, for large-scale data processing systems supporting cloud computing use cases, distributed file systems such as Hadoop have been proposed. Hadoop-based systems provide decentralized file system performance with a decentralized architecture to achieve business resilience despite the fact that entire racks of servers and storage systems are unavailable due to loss of network connectivity, hardware failure, or catastrophic failure ( resiliency), but Hadoop solutions (and distributed computing solutions in general) also cannot support policy-driven service-level agreements for external consumers in a transparent manner. [0003] Hadoop is a software framework that supports data-intensive distributed applications. Hadoop enables applications to work with thousands of computing independe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCH04L41/5051H04L41/5054H04L43/04H04L67/00G06F9/5072
Inventor S.内尔克M.A.奥伯霍弗Y.赛莱特J.塞弗特
Owner IBM CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products