Exadata Simulation on VMWare Part-1
Hi Guys,
After long time blogging new post, this time we will see how to simulate Exadata environment in vmware.
Note :
This is for learning purpose and a simulation to practice the commands but the actual performance and other features can only be experienced on real exadata machines.
My environment going to be:
Storage cell servers:
- Exacel01.hussain.net = 192.168.0.130 (Public)
10.0.0.100 (Private)
2. Exacel02.hussain.net = 192.168.0.131 (Public) 10.0.0.101(Private)
Database Compute nodes:
- Exadb01.hussain.net = 192.168.0.133 (Public) 10.0.0.50 (Private)
2. Exadb02.hussain.net = 192.168.0.134 (Public) 10.0.0.51 (Private)
Virtual ip’s:
192.168.0.152 = exadb01-vip.hussain.net
192.168.0.153= exadb02-vip.hussain.net
Scan ip’s:
Exa-scan.hussain.net = 192.168.0.163
192.168.0.164
192.168.0.165
Operating system: Oracle Enterprise Linux 5.8
Exadata storage software version: 11.2.3.2.1 and zip file is V36290-01.zip (Download from oracle edelivery)
Grid and Database version : 11.2.0.3
Now, will create a VM and will clone the same for the rest of three servers.
Please follow below screenshots and install OS OEL 5.8
After rebooting system, login into the system using root credentials.
And setup network ipaddress, install VMware tools.
In my case: Ip address 192.168.0.130 (Public) and 10.0.0.100 (Private)
Configure yum repository, actually it’s not needed for cell server, but I’m cloning the same server for database nodes right where I require yum repository to install database related rpm.
Update the /etc/hosts file with below information.
Update the below configuration files with specified parameter values.
vi /etc/sysctl.conf
fs.file-max = 655360
=============================================
vi /etc/security/limits.conf
* soft nofile 655360
* hard nofile 655360
==============================================
vi /etc/grub.conf
default=1
==============================================
vi /etc/bashrc
export DISPLAY=:0
===============================================
Vi ~/.rpmmacros
%_query_all_fmt %%{name}-%%{version}-%%{release}
================================================
mkdir /var/log/oracle
chmod 775 /var/log/oracle
================================================
Copy the Exadata storage software to /stage directory and extract it.
Now install JDK and cell software rpm which we extracted and restart the server.
Create the soft links for the extra added disks to use as celldisk.
fdisk -l 2>/dev/null |grep ‘B,’
mkdir -p /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw
cd /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw
ln -s /dev/sdb exacel01_DISK01
ln -s /dev/sdc exacel01_DISK02
ln -s /dev/sdd exacel01_DISK03
ln -s /dev/sde exacel01_DISK04
ln -s /dev/sdf exacel01_FLASH01
ln -s /dev/sdg exacel01_FLASH02
Check the services and we should have to configure cell(in my case) with eth1 ipaddress i.e 10.0.0.100.
Check the physical disk and Lun
By using celldisk create the griddisk and repeat the whole activity for exacel02 server as well, as we are going to have two Exadata storage servers.
And these grid disks are used to configure the diskgroups through ASM from database compute nodes.
In next post, will see how to install and configure Oracle Grid Infrastructure and RDBMS software.
Happy Learning,
Firoz K. Hussain.
Oracle ACE Associate.
Hello ,
Please publish your second part of this post
Exadata Simulation on VMWare Part-2
Hi, Hari shankar,
Sorry for late reply, will do that soon.
Regards,
Firoz K. Hussain.
Hi, where is part 2?
Thanks
waiting for your part 2 man. Thanks!
Hi Sir — I have successfully installed cell RPM but , post that i am struggling to fix GUI issue . for more that i have recreated different OS version 5.3 / 5.8 /5.10 but issue remain same .
tried to set en variable / try to run from VNC by configuring it . I am still not able to understand/fix issue which you fixed and worked for you easily ………. please help me in this ….i m totally frustrated because of this …or suggest alternate option
mohammed.riyazdba@gmail.com
Hi,
Sorry for the late reply, can you send the screenshot of the error, if it’s still presists.
Regards,
KFHussain.
firozhussain@gmail.com
Hi,
Do you still have a installation guide how to build your own Exadata VMware ?
Can’t find the download *.zip files anymore and can install it like your discripted.
Do you have a up-to-date (2020-09-26) installation guide ?
I am new to Exadata Oracle installation but want to learn about this.
Kind Regards,
Chris
Hi Chris,
It was configured quite sometime before, I should have to check the repository for the softwares which i used in this blog post.
But, if you are asking for the latest one, I didn’t check that.
Regards,
KFHussain.
I was able to build the storage server without any problems, but during the last step of grid installation , root.sh script is failing or hung when creating ASM instance. I tired multiple times and every time its getting stuck at that step. So, any help would be really appreciated.
Many Thanks,
Kalyan
Hi Kalyan,
I think it will be bcoz of below missing parameters, please have a look and let me know if you have the issue.
Go to cellinit.ora of the cell server and edit with below lines.
version=0.0
bbuTempThreshold=60
_cell_io_hang_time=60
_cell_num_buffers=1000
_cellrsdef_srvc_dump=30
_skgxp_gen_ant_off_rpc_timeout_in_sec=300
_cell_num_1mb_buffers=100
_cellrsms_poll_invl=60
bbuChargeThreshold=800
_cell_io_hang_reboot=false
_reconnect_to_cell_freq_in_sec=4
_cellrsos_poll_invl=15
_reconnect_to_cell_attempts=4
_cell_1mb_buffers_hugepage_support=false
_ms_cell_ioctl_timeout=60000
RMI_PORT=23791
_skgxp_udp_use_tcb_client=true
_cellrsbkp_poll_invl=15
_skgxp_gen_rpc_timeout_in_sec=90
_cellrsdef_fast_restart=0
MC_SNMP_PORT=162
_skgxp_udp_use_tcb=false
_cellrsdef_srvc_cleanup_time=5
_cellrsdef_heartbeat_timeout=600
_cell_disable_ant_check_reid=true
BMC_SNMP_PORT=162
_cellrssrv_poll_invl=15
_cellrsos_start_timeout=1800
HTTP_PORT=8888
_cell_print_all_params=true
DEPLOYED=TRUE
ipaddress1=10.0.0.100/24
JMS_PORT=9127
_cell_num_1mb_brr_buffers=5
_cell_num_1mb_bwr_buffers=5
SSL_PORT=23943
Regards,
KFHussain
Hi Hussain,
Thanks for your reply. I was not able to create voting disk as part of root.sh script. I guess not able to write on ASM disks
Many Thanks,
Kalyan
Hi Hussain,
Thanks for your prompt response, let me try the options suggested by you. Also, disk discovery using kfod is happening on oel 6 and above but for oel version below 6, disk discovery is not happening as it should. looks like few packages are missing on oel 5.9. will keep you updated
Many Thanks,
Kalyan
Hi Hussain,
I have explored the options suggested by you but did not work. I dont see any progress after this step and due to this ASM instance is not created. Thanks for your help.
2021-08-12 17:30:28: Executing as oracle: /u01/app/19.0.0/grid/bin/asmca -silent -diskGroupName DATA -diskList ‘o/192.168.2.60/DATA_CD_DISK01_cnode,o/192.168.2.60/DATA_CD_DISK02_cnode,o/192.168.2.60/DATA_CD_DISK03_cnode,o/192.168.2.60/DATA_CD_DISK04_cnode’ -redundancy EXTERNAL -diskString ‘o/*/*’ -configureLocalASM -passwordFileLocation +DATA/orapwASM -au_size 4
2021-08-12 17:30:28: Running as user oracle: /u01/app/19.0.0/grid/bin/asmca -silent -diskGroupName DATA -diskList ‘o/192.168.2.60/DATA_CD_DISK01_cnode,o/192.168.2.60/DATA_CD_DISK02_cnode,o/192.168.2.60/DATA_CD_DISK03_cnode,o/192.168.2.60/DATA_CD_DISK04_cnode’ -redundancy EXTERNAL -diskString ‘o/*/*’ -configureLocalASM -passwordFileLocation +DATA/orapwASM -au_size 4
2021-08-12 17:30:28: Executing /bin/su oracle -c “/u01/app/19.0.0/grid/bin/asmca -silent -diskGroupName DATA -diskList ‘o/192.168.2.60/DATA_CD_DISK01_cnode,o/192.168.2.60/DATA_CD_DISK02_cnode,o/192.168.2.60/DATA_CD_DISK03_cnode,o/192.168.2.60/DATA_CD_DISK04_cnode’ -redundancy EXTERNAL -diskString ‘o/*/*’ -configureLocalASM -passwordFileLocation +DATA/orapwASM -au_size 4 ”
2021-08-12 17:30:28: Executing cmd: /bin/su oracle -c “/u01/app/19.0.0/grid/bin/asmca -silent -diskGroupName DATA -diskList ‘o/192.168.2.60/DATA_CD_DISK01_cnode,o/192.168.2.60/DATA_CD_DISK02_cnode,o/192.168.2.60/DATA_CD_DISK03_cnode,o/192.168.2.60/DATA_CD_DISK04_cnode’ -redundancy EXTERNAL -diskString ‘o/*/*’ -configureLocalASM -passwordFileLocation +DATA/orapwASM -au_size 4 ”
Many Thanks,
Kalyan
I was installing the storage server software but on e dependency “/usr/bin/python is needed ” is giving me trouble and i can’t seem to fix it.