ASM disk creation
| Topic ID: 2638 | |
| Created By: | 2007-SEP-22 06:19:14 [Mson77dba] |
| Updated By: | 2007-SEP-27 22:12:53 [Vitaliy] |
| Status: | Open |
| Severity: | Normal |
| Read Only: | No |
|
8311
2007-SEP-22 06:19:14
|
||||
|
Hello,
My environment is Fedora 7 (kernel 2.6.22.5-76.fc7) and I have oracle 10g (v
10.2.0.1 32bit) installed.
I have 03 disks installed. They are:
/dev/sda
/dev/sdb (unused)
/dev/sdc (unused)
The device /dev/sda is being used by Fedora7.
The other 2 devices ("b" and "c") I want use them as ASM. They are not
partitioned yet. Just visible to fedora when "fdisk -l" command is issued.
To make them available as ASM disks... I have to download the utilities:
==> oracleasm-support
==> oracleasmlib
==> oracleasm
As oracle does not support Fedora7... how can I go on? I mean, how can I get
oracleasm/oracleasmlib/oracleasm-support? No way?
Well... if ASM is not possible with Fedora7... any suggestion to implement
shared disk architecture? Should I use OCFS2? Is it possible on Fedora7? I
guess it is the same case as ASM.
No way for Fedora7...(to create shared disk architecture)?
Thank you!
mson77
[edited by: Mson77dba at 06:23 (CST) on Sep. 22, 2007]
|
8314
2007-SEP-22 10:07:45
|
||||
|
Welcome back mson77! If you are _not_ planning to run Oracle RAC then you do not need ASM at all. Just "cook" these drives using Fedora's fdisk and present them to oracle as a native file systems. If you are planning to run Oracle RAC/ASM then I would suggest downloading Oracle's Enterprise Linux (repackaged Red Hat) here: http://edelivery.oracle.com/linux you'll be much better off with their distribution. - Vitaliy
|
8315
2007-SEP-22 11:02:11
|
||||
|
Hello Vitaliy, I always appreciate a lot you very kind and helpful information. My experiences are done at home. I am studying oracle since last month... reading, implementing and testing to become familiar with this oracle world. My target is to create a RAC environment... and then my first barrier was "installing shared disk"... and as ASM is a well marketed method... I am trying to use this method. I have read that maybe ASM will take place of OCFS. Maybe should I use raw devices? Do you have any opinion about using raw devices? Regards, mson77
|
8316
2007-SEP-22 12:07:59
|
||||
|
Mson77, I understand that you want to learn and test Oracle RAC. Here's the problem - Oracle RAC is a major undertaking - Major with a capital M. Oracle RAC will require a lot of your time (investment) so what good does it do to you to learn in on a platform that is not even close to what Oracle supports for production use? Lets say you get this (Fedora/Oracle) to work and then you'll want to propose this solution to your employer or a customer ... what are you going to tell them? "I know RAC - I tested it on XYZ but XYZ is not really supported but don't worry I'll make it work for you ..." Does it sound professional? I don't mean to sound negative I just want you to ask yourself some hard questions ... Here's where I stand on RAC today - I've been researching it for 10 months, reading sample installs, testing Oracle 10gR2 on Linux, reading up on hardware platforms, SAN's, NAS, Pillar, NetAPP etc.. Evaluating NetAPP vs Pillar. After all of this research we have decided to implement Oracle RAC on Dell PE 2950's attached via HBA's to Pillar Axiom 500. We are in final stages of starting our hardware build and by November I think we'll start laying down Oracle software. By then I'll be able to provide more hands on feedback on Oracle RAC. Right now I can only help you with my research (See below):
Install 10g RAC on Linux
Oracle 10gR2 Documentation Page: http://www.oracle.com/pls/db102/homepage Installing Oracle Database 10g Release 2 on Linux x86 http://www.oracle.com/technology/pub/articles/smiley_10gdb_install.html Installing Oracle RAC 10g Release 2 on Linux x86 http://www.oracle.com/technology/pub/articles/smiley_rac10g_install.html Build Your Own Oracle RAC 10g Release 2 Cluster on Linux and iSCSI http://www.oracle.com/technology/pub/articles/hunter_rac10gr2_iscsi.html Installing Oracle Database 10g with Real Application Cluster (RAC) on Red Hat Enterprise Linux Advanced Server 3 http://www.puschitz.com/InstallingOracle10gRAC.shtml Oracle EL (Enterprise Linux based on REDHAT Linux) http://edelivery.oracle.com/linux FireWire driver for Oracle EL http://oss.oracle.com/projects/firewire/files/Oracle/EL4/
Oracle 10gR2 on Linux x86
Here are my install tests so far ## Install Oracle 10gR2 on Oracle Enterprise Linux 4 (Red Hat Linux 4) ## ## Based on http://www.oracle.com/technology/pub/articles/smiley_10gdb_install.html#oracle ## ## ## Verify Hardware ## ## determine the physical RAM size: ## (At least 1024 MB of physical RAM) ## [root@bosco software]# grep MemTotal /proc/meminfo MemTotal: 1034176 kB ## determine the size of the configured swap space ## (1.5 times of RAM) ## [root@bosco software]# grep SwapTotal /proc/meminfo SwapTotal: 5116692 kB ## determine the amount of disk space available in the /tmp directory ## (at least 400m) ## [root@bosco software]# df -k /tmp Filesystem 1K-blocks Used Available Use% Mounted on /dev/hda1 14199816 3744580 9733920 28% / ## amount of free disk space on the system ## (at least 1.5gb for software files) ## [root@bosco software]# df -k Filesystem 1K-blocks Used Available Use% Mounted on /dev/hda1 14199816 3744580 9733920 28% / none 517088 0 517088 0% /dev/shm ## determine whether the system architecture can run the software ## [root@bosco software]# grep "model name" /proc/cpuinfo model name : Intel(R) Pentium(R) 4 CPU 2.00GHz ## ## Checking the Software Requirements ## ## determine which distribution and version of Linux is installed ## see http://download-west.oracle.com/docs/cd/B19306_01/install.102/b15660/pre_install.htm#sthref111 ## for the list of supported Linux installations ## (in our case it's Red Hat Enterprise Linux 4.0 "Oracle's EL cut") ## [root@bosco software]# cat /etc/issue Enterprise Linux Enterprise Linux AS release 4 (October Update 4) Kernel \r on an \m ## determine whether the required kernel is installed ## (for our Red Hat based Oracle EL 4.0 we must be on 2.6.9-5.EL or above) ## [root@bosco software]# uname -r 2.6.9-42.0.0.0.1.EL Explanation of the above: kernel version (2.6.9) errata level (42.0.0.0.1.EL) ## determine whether the required packages are installed ## ## we should have the following packages (Red Hat Enterprise Linux 4.0): ## binutils-2.15.92.0.2-13.EL4 ## compat-db-4.1.25-9 ## compat-libstdc++-296-2.96-132.7.2 ## control-center-2.8.0-12 ## gcc-3.4.3-22.1.EL4 ## gcc-c++-3.4.3-22.1.EL44 ## glibc-2.3.4-2.9 ## glibc-common-2.3.4-2.9 ## gnome-libs-1.4.1.2.90-44.1 ## libstdc++-3.4.3-22.1 ## libstdc++-devel-3.4.3-22.1 ## make-3.80-5 ## pdksh-5.2.14-30 ## sysstat-5.0.5-1 ## xscreensaver-4.18-5.rhel4.2 ## setarch-1.6-1 ## ## note you should use compat-libstdc++-33 instead of compat-libstdc++ when querying RPMs ## see http://dbatoolz.orapros.com/tp/1756.package_compat-libstdc_is_not_installed.html ## rpm -q binutils compat-db compat-libstdc++-33 \ control-center gcc gcc-c++ glibc \ glibc-common gnome-libs libstdc++ \ libstdc++-devel make pdksh \ sysstat xscreensaver setarch libaio [root@bosco RPMS]# rpm -q binutils compat-db compat-libstdc++-33 \ > control-center gcc gcc-c++ glibc \ > glibc-common gnome-libs libstdc++ \ > libstdc++-devel make pdksh \ > sysstat xscreensaver setarch libaio binutils-2.15.92.0.2-21 compat-db-4.1.25-9 compat-libstdc++-33-3.2.3-47.3 control-center-2.8.0-12.rhel4.5 gcc-3.4.6-3.1 gcc-c++-3.4.6-3.1 glibc-2.3.4-2.25 glibc-common-2.3.4-2.25 gnome-libs-1.4.1.2.90-44.2 libstdc++-3.4.6-3.1 libstdc++-devel-3.4.6-3.1 make-3.80-6.EL4 pdksh-5.2.14-30.3 package sysstat is not installed xscreensaver-4.18-5.rhel4.12 setarch-1.6-1 package libaio is not installed we have TWO pkg missing: sysstat libaio NOTE: libaio is only needed for the Demo database install put in the Third CD that you download from Oracle edelivery and install: sysstat-5.0.5-11.rhel4.i386.rpm libaio-0.3.105-2.i386.rpm [root@bosco RPMS]# pwd /media/cdrecorder/Enterprise/RPMS [root@bosco RPMS]# rpm -iv sysstat-5.0.5-11.rhel4.i386.rpm warning: sysstat-5.0.5-11.rhel4.i386.rpm: V3 DSA signature: NOKEY, key ID b38a8516 Preparing packages for installation... sysstat-5.0.5-11.rhel4 [root@bosco RPMS]# [root@bosco RPMS]# rpm -iv libaio-0.3.105-2.i386.rpm warning: libaio-0.3.105-2.i386.rpm: V3 DSA signature: NOKEY, key ID b38a8516 Preparing packages for installation... libaio-0.3.105-2 [root@bosco RPMS]# rpm -q sysstat sysstat-5.0.5-11.rhel4 [root@bosco RPMS]# rpm -q libaio libaio-0.3.105-2 ## ## Checking the Network Setup ## ## Verify that the /etc/hosts file is used for name resolution ## (files should be before dns) ## [root@bosco ~]# cat /etc/nsswitch.conf | grep hosts #hosts: db files ldap nis dns hosts: files dns ## Verify that the host name has been set ## [root@bosco ~]# hostname bosco.sub.yourdomain.com ## Verify that the domain name has not been set ## (command should not return any results) ## [root@bosco ~]# domainname (none) ## Verify that the hosts file contains the fully qualified host name ## (fully qualified host name should be listed BEFORE the short-cut alias) ## [root@bosco ~]# cat /etc/hosts | grep `eval hostname` 198.206.187.47 bosco.sub.yourdomain.com bosco ## ## Creating Required Operating System Groups and Users ## ## verify there's no existing Oracle install ## [root@bosco ~]# more /etc/oraInst.loc /etc/oraInst.loc: No such file or directory ## create oracle groups and users ## /usr/sbin/groupadd oinstall /usr/sbin/groupadd dba /usr/sbin/useradd -g oinstall -G dba oracle ## create oracle home dirs ## mkdir -p /u01/app/oracle chown -R oracle:oinstall /u01/app/oracle vi /etc/passwd ---- change home directory as follows ----- oracle:x:500:500::/u01/app/oracle:/bin/ksh :x ## test oracle can login [root@bosco ~]# su - oracle $ pwd /u01/app/oracle $ id uid=500(oracle) gid=500(oinstall) groups=500(oinstall),501(dba) ## Set the password of the oracle user ## [root@bosco ~]# passwd oracle Changing password for user oracle. New UNIX password: Retype new UNIX password: passwd: all authentication tokens updated successfully. ## Verify that the User nobody Exists ## [root@bosco ~]# id nobody uid=99(nobody) gid=99(nobody) groups=99(nobody) ## ## Configuring Kernel Parameters ## ## if this is a new Linux install just do the following to set it all up ## otherwise verify these are correctly set ## cat >> /etc/sysctl.conf <<EOF kernel.shmall = 2097152 kernel.shmmax = 2147483648 kernel.shmmni = 4096 kernel.sem = 250 32000 100 128 fs.file-max = 65536 net.ipv4.ip_local_port_range = 1024 65000 net.core.rmem_default = 1048576 net.core.rmem_max = 1048576 net.core.wmem_default = 262144 net.core.wmem_max = 262144 EOF [root@bosco ~]# /sbin/sysctl -p net.ipv4.ip_forward = 0 net.ipv4.conf.default.rp_filter = 1 net.ipv4.conf.default.accept_source_route = 0 kernel.sysrq = 0 kernel.core_uses_pid = 1 kernel.shmall = 2097152 kernel.shmmax = 2147483648 kernel.shmmni = 4096 kernel.sem = 250 32000 100 128 fs.file-max = 65536 net.ipv4.ip_local_port_range = 1024 65000 net.core.rmem_default = 1048576 net.core.rmem_max = 1048576 net.core.wmem_default = 262144 net.core.wmem_max = 262144 ## Set Shell Limits for the oracle User ## cat >> /etc/security/limits.conf <<EOF oracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536 EOF cat >> /etc/pam.d/login <<EOF session required /lib/security/pam_limits.so session required pam_limits.so EOF cat >> /etc/profile <<EOF if [ \$USER = "oracle" ]; then if [ \$SHELL = "/bin/ksh" ]; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi fi EOF cat >> /etc/csh.login <<EOF if ( \$USER == "oracle" ) then limit maxproc 16384 limit descriptors 65536 endif EOF ## ## Setup ORACLE_HOME, ORACLE_BASE and database file directories ## chmod -R 775 /u01/app/oracle mkdir /u01/oradata chown oracle:oinstall /u01/oradata chmod 775 /u01/oradata mkdir /u01/flash_recovery_area chown oracle:oinstall /u01/flash_recovery_area chmod 775 /u01/flash_recovery_area su - oracle vi .profile ------------ insert the following ------------ ## Setting the ORACLE_HOSTNAME Environment Variable ## NOTE: ## allthough it's not required I think it's best to set this ## to avoid any ambiguity in the future if we decide to add ## multiple NICs or if we will have Virtual host type setup ## ORACLE_HOSTNAME=bosco.sub.yourdomain.com; export ORACLE_HOSTNAME ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE ORACLE_HOME=/u01/app/oracle/product/10.2.0/db_1; export ORACLE_HOME ORACLE_SID=X10G; export ORACLE_SID umask 022 DISPLAY=198.206.187.158:0.0 ; export DISPLAY ## that's zephir ... set -o vi PS1="`/bin/hostname`.$ORACLE_SID-> " ## verify umask: ## su - oracle bosco.sub.yourdomain.com.X10G-> umask 022 ## ## Installing Oracle Oracle Database 10g Release 2 (10.2.0.1.0) ## ## download 10201_database_linux32.zip from ## http://www.oracle.com/technology/software/products/database/oracle10g/htdocs/10201linuxsoft.html bosco.sub.yourdomain.com.X10G-> pwd /u01/app/oracle/software bosco.sub.yourdomain.com.X10G-> ls -lta total 653716 drwxrwxr-x 3 oracle oinstall 4096 Feb 27 18:54 .. -rwxrwxr-x 1 oracle oinstall 668734007 Feb 23 19:27 10201_database_linux32.zip drwxrwxr-x 2 oracle oinstall 4096 Feb 23 19:25 . unzip 10201_database_linux32.zip ## start install ## /u01/app/oracle/software/database/runInstaller ## First lets test Started Database ## which will go into /u01/app/oracle/oradata/X10G/ (hardwired by installer) ## Select Installation Method (o) Basic Installation Oracle Home Location: /u01/app/oracle/product/10.2.0/db_1 Installation type: Enterprise Edition UNIX DBA Group: oinstall [x] Create Starter Database Global Database Name: X10G Database Password: demo1 Next Specify Inventory directory and credentials /u01/app/oracle/oraInventory oinstall Next Product-Specific Prereqs. Checks all should have status Succeded Next Sumary Review Install [7:36 -- 7:51] Database Configuration Assistant Review Summary of Database Configuration Database Control URL: http://bosco.sub.yourdomain.com:1158/em [sys/demo1] Ok Run the following scripts as root: /u01/app/oracle/oraInventory/orainstRoot.sh /u01/app/oracle/product/10.2.0/db_1/root.sh [root@bosco oraInventory]# /u01/app/oracle/oraInventory/orainstRoot.sh Changing permissions of /u01/app/oracle/oraInventory to 770. Changing groupname of /u01/app/oracle/oraInventory to oinstall. The execution of the script is complete [root@bosco db_1]# [root@bosco db_1]# /u01/app/oracle/product/10.2.0/db_1/root.sh Running Oracle10 root.sh script... The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1 Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ... Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. [root@bosco db_1]# NOTE: /var/opt/oracle file are now in /etc/ora*: [root@bosco db_1]# ls -l /etc/ora* -rw-r--r-- 1 root root 63 Feb 27 20:00 /etc/oraInst.loc -rw-rw-r-- 1 oracle root 721 Feb 27 20:01 /etc/oratab Click OK (on the Execute Config scripts as root window) THE END OF INSTALL Configuration Details: [root@bosco install]# cat /u01/app/oracle/product/10.2.0/db_1/install/readme.txt The following J2EE Applications have been deployed and are accessible at the URLs listed below. iSQL*Plus URL: http://bosco.sub.yourdomain.com:5560/isqlplus iSQL*Plus DBA URL: http://bosco.sub.yourdomain.com:5560/isqlplus/dba Enterprise Manager 10g Database Control URL: http://bosco.sub.yourdomain.com:1158/em [root@bosco install]# cat /u01/app/oracle/product/10.2.0/db_1/install/portlist.ini iSQL*Plus HTTP port number =5560 Enterprise Manager Console HTTP Port (X10G) = 1158 Enterprise Manager Agent Port (X10G) = 3938 [root@bosco install]#
[edited by: Vitaliy at 12:35 (CST) on Sep. 22, 2007]
|
8320
2007-SEP-22 14:38:26
|
||||
|
Hello Vitaliy, Thank you for your clearness and completeness. Regarding: >"on Dell PE 2950's attached via HBA's to Pillar Axiom 500" ==> How many Dell PE 2950 you will use with Pillar Axiom 500? ==> How many Pillar Axiom 500? Just 01? ==> This kind of architecture/infrastructure targets what kind of needs? I mean... it will be used to provide what? Regards, mson77
|
8322
2007-SEP-22 15:00:24
|
||||
|
Mson77, Our Pillar Axiom will consist of the following: 1 x SAN Slammer (500-SAN-4G) 1 x Pilot console 2 x FC Brick RAID Each FC Brick has 12 146GB/15K RPM Drives giving us a total of 2.8TB usable space. We were supposed to get 3 Dell 2950's but might have to go with only 2 for now. This is our pilot (test) system. Our objective is to evaluate performance, maintenance and overall stability of the system. We are mostly Sun shop so we'll be comparing performance of this system against our current Sun v890's. If this proves to be a flop we'll just use Pillar storage for other needs and reuse Dell 2950's elsewhere. If this proves to be a valuable solution we might start putting some of our less critical production systems on it to see how it fairs in real production environment. Regards, - Vitaliy
|
8323
2007-SEP-22 16:24:25
|
||||
|
Hello Vitaliy, Woww... what a system!!! Big boy system! I wish SUCESS to YOU!!! Thank you! mson77 PS: If you have any news... please let me know too!
|
8324
2007-SEP-22 17:55:21
|
||||
|
> I wish SUCESS to YOU!!! Thanks! > PS: If you have any news... please let me know too! No problem.
|
8343
2007-SEP-27 19:26:08
|
||||
|
Hello Vitaliy.... Did you see this? http://www.fusionio.com/iodrivedata.pdf Regards, mson77
|
8346
2007-SEP-27 19:52:23
|
||||
|
I wonder what's the catch? Price?
"FusionIO drive is a solid state drive (SSD) that holds
about 700 Gbytes of data and can do 100,000 IOPS."
I like the idea, in fact I just bought a new Sony DigiCam that uses flash
memory instead of a tape or a drive.
Lets see what the price is going to be - I am really curious.
|
8347
2007-SEP-27 19:57:54
|
||||
|
Hello Vitaliy, I have no idea about pricing. But I read that SSD (solid state disk) offer is growing. See this: http://www.superssd.com/ Regards, mson77
|
8348
2007-SEP-27 20:12:23
|
||||
|
> But I read that SSD (solid state disk) offer is growing. > Definitely - it's the future. I think what's holding everything back is the cost. > See this: > http://www.superssd.com/ > From what I understand RamSan-500 has paired DDR-based solid state disk devices with "cheaper" flash memory. In their setup DDR is used as a write cache to overcome slow writes to the flash memory which is used for storage (just like HDD's are used now). Reads are dispatched directly to flash memory. I guess this reduces the cost. I have not researched this until now but - but here's their write-up on Oracle: http://www.texmemsys.com/files/f000139.pdf Regards, - Vitaliy
|
8349
2007-SEP-27 20:31:02
|
||||
|
Hello Vitaliy, See this: http://www.fusionio.com/demo.html Regards, mson77
|
8352
2007-SEP-27 21:57:05
|
||||
|
> See this: > http://www.fusionio.com/demo.html > Pretty funny - this guy is like a stand up comedian - great way to keep everyone awake. He also made a good mock-up of what our SAN system will look like :-) One thing remains unanswered though - how much does it cost?
|
8355
2007-SEP-27 22:12:53
|
||||
|
> He also made a good mock-up of what our SAN system will look like :-) I started a new thread to post updates on our Pillar implementation - we just received the boxes: Oracle on Pillar storage implementation