Solicitamos su permiso para obtener datos estadísticos de su navegación en esta web. Si continúa navegando consideramos que acepta el uso de cookies. OK | Política de cookies | Política de Privacidad
Language: English
RSS

Follow us ...

  • Twitter FacebbokFlickrYouTube CESGA

SME Services

  • Servicios para Empresas

díxitos Marzo 2019


  • CESGA ICTS

Big Data

 

1. Introduction

The Big Data service allows the processing of large volumes of information in parallel, using the power of modern tools that simplify the process considerably..

The service has two different environments to meet the needs of all users:

  • CDH 6.1.1 environment (Hadoop 3): It offers a platform based on Hadoop 3 that supports the main components of the Hadoop ecosystem.
  • Platform as a Service (PaaS) environment: For cases where you need to go beyond what the Hadoop ecosystem offers: Cassandra, MongoDB, Redis, ...

All the information about each of the environments is available in the specific portal of the platform: https://bigdata.cesga.es

2. Hardware description

The Big Data service consists of a 38 nodes dedicated cluster (4 master nodes and 34 slave nodes). It has a gross capacity of 816 TB, an aggregated I/O capacity of more than 30 GB/s and a 10GbE connection between all the cluster nodes.

  • 34 Slave nodes: Lenovo System x3650 M5

CPU: 2x Intel Xeon E5-2620 v3 @ 2.40GHz
Cores: 12 (2x6)
HyperThreading: Activo (24 threads)
Memoria total: 64GB
Red: 1x10Gbps + 2x1Gbps
Discos: 12x 2TB NL SATA 6Gbps 3.5" G2HS
Controladora: N2215 SAS/SATA HBA

  • 4 Master node: Lenovo System x3550 M5

CPU: 2x Intel Xeon E5-2620 v3 @ 2.40GHz
Cores: 12 (2x6)
HyperThreading: Activo (24 threads)
Memoria total: 64GB
Red: 1x10Gbps + 2x1Gbps
Discos: 8x 480GB SSD SATA 2.5" MLC G3HS
Controladora: ServeRAID M5210 1GB Cache FastPath

  • Switches:

2x Lenovo RackSwitch G8124E
2x Lenovo RackSwitch G8052
1x Lenovo RackSwitch G7052

3. WebUI: Interfaz Web

The platform has a web interface (WebUI) to simplify the use of the platform to new users who have not had prior contact with Big Data tools. The WebUI allows to perform the most common tasks in a simple way and is a complement for the command line.

4. User Guide and Tutorials

 

The Big Data platform has a specific portal with all the information:  https://bigdata.cesga.es