Sourcing intelligence from customs data

List of contents of this article:

• 1,Sourcing intelligence from customs data What is a distributed system?
• 2, Distributed storage Deploy at least several storage nodes
• 3, What are the characteristics of distributed systems?
• 4, What are the distributed file storage systems

What is a distributed system?

A distributed system is a system in which hardware or software components are distributed on different network computers and communicate and coordinate with each other only through messaging. It is precisely because of the characteristics of the software that the distributed system has a high degree of cohesion and transparency.

A distributed system is a software system built on the network. Process the assistance task, and then integrate the results. In a distributed system, a group of independent computers present a unified whole to the user, just like a system.

Distributed system is a software system built on the network. It is precisely because of the characteristics of the software that the distributed system has a high degree of cohesion and transparency. ThereforeThe difference between networks and distributed systems lies more in high-level software (especially operating systems) than hardware.

It is a multi-processor computer system, and each processor forms a unified system through an interconnected network. The system adopts a distributed computing structure, that is, the tasks handled by the central processor in the original system are distributed to the corresponding processors, so as to realize the mutual coordination of various processors with different functions, and the peripherals and software of the system are shared.

Distributed storage deploys at least several storage nodes

1. Distributed storage can deploy at least one storage node, but in practical applications, multiple storage nodes are usually deployed to improve data reliability and System performance.

2.FC-SAN (FibreChannelStorageAreaNetwork) is a storage area network solution that requires at least two nodes to establish connections and transmit data. These two nodes can be a host, a storage device or a switch, etc.

3. Pseudo-distributed mode: run in the mode of multiple processes on a single computer.

What are the characteristics of distributed systems?

Features of distributed system: distribution. Distributed systems consist of multiple computers, which are geographically scattered and can be scattered in a unit, a city, a country, or even globally. The functions of the whole system are distributed on each node, so the distributed system has the distribution of data processing.

The computers in the network themselves are reciprocal, and there is no master-slave division. However, in order to consider its own robustness and reliability, the distributed system will design some redundancy to solve some of the inevitability of the distributed system itself.

One is the network. All components of the distributed system are located in the network. For Internet applications, they are located in a more complex Internet environment.

A distributed computer system is a computer system formed by multiple computers through network connection. Its main features include: distribution: computing resources and data storage in the distributed computer system are distributed on different computing nodes, which can be physical distribution or logical distribution. Cloth.

What are the distributed file storage systems

At present, in addition to GPFS, several mainstream distributed file systems also include PVFS, Lustre, PanFS , GoogleFS, etc.

Ceph: Ceph is an open source distributed storage system that adopts a scalable object storage model. It hasIt has the characteristics of high reliability, high scalability and high performance, and excels in large-scale data storage.

NFS/CIFS is the most common distributed file system, which is the NAS system. In a distributed file system, the number of nodes of the storage server may be 1 (such as traditional NAS) or multiple (such as cluster NAS). For a single-node distributed file system, there are single-point faults and performance bottlenecks.

HDFS (Hadoop Distributed File System) is a distributed file system that is mainly used to store a large amount of data and provide highly reliable and high-throughput data access. Therefore, HDFS is a distributed file system that can really store data.

What are the file systems?GoogleFS (GoogleFileSystem) is a distributed file system designed by Google to meet the company's internal data processing needs.