yadenmustopa/learn_shell_script

title	ouput
Problem And Resolve for learn shell scripting	pdf_document

Learn Shell Scripting

PROBLEM AND SOLVING

1. when clonning git use HTTPS

   1. Problem

      NOTES: when cloning git in ubuntu not simply in windows

   2. solving

       git clone https://[user]:token@link_reposity
      

      for easy way in your linux ,, make sure you made invorentment variable for username and your token

2. when cloning git use SSH

   • Step 1 Check For Existing SSH Keys

     $> ls -al ~/.ssh
     

     Do you see any files named id_rsa and id_rsa.pub?

     If yes go to Step 3

     Notes : If no, you need to generate them

     
     

   • Step 2 Generate a new SSH Key

     $> ssh-keygen -t rsa -b 4096 -C "Your Email" -f ~/.ssh/id_rsa -P ""
     

     and your SSH key to the ssh-agent

     $> eval "$(ssh-agent -s)"
     

     $> ssh-add ~/.ssh/id_rsa
     

     
     

   • Step 3.1 Add the SSH key to your GIT account Get Your public key

     $> cat ~/.ssh/id_rsa.pub
     

     go to your GIT project -> Settings -> SSH Keys

     Then paste the content of your public key in SSH keys

     
     

   • Step 3.2 Force SSH Client To use Given Private Key
     

     Notes : this is an alternative solution when you can't set keys on your GIT account

     
     ``` $> sudo nano ~/.ssh/config ```

     Then change this line

     IdentityFile < yourPrivateKey >

     
     

   • Step 4 Clone your Project Repository

     git clone [email protected]:$USERNAME/$REPONAME.git
     

     and if you want to test your SSH is success connecting or not, then following this command

     ssh -T [email protected]
     

     more info

   If You want move ssh file in another device

    1. create ssh
    2. copy file to ~/.ssh
    3. change mode and owner
    4 ```shell
           sudo chown -R $USER ~/.ssh
           sudo chmod 700 ~/.ssh
           sudo chmod 600 ~/.ssh/
           find /Users/yadenmustopa/.ssh -type f -exec chmod 600 {} \;
        ```
   

3. Problem when issue write export PATH

   at the time my friend test laravel in ubuntu OS,, after setting variable environtment PATH and then he failure writte PATH and become error for ubuntu system and not loggin with KDE.

   
   
   1. Problem this warning when command shell apt or anything become error for console.

   bash: export `=` not a valid identifier
   

   2. Solving

      if your position has logged in , go to step 2

      • step 1 a. hold Ctrl + ALT + F5

        b. and then your login user your username and your password

      • step 2 because my friend failure when create PATH in ~/.bashrc then following this command :

        sudo nano ~/.bashrc
        

        after open content file .bashrc , Delete PATH which failure and hold Alt + X And holdY

      • Step 3

            sudo systemctl reboot
        

      
      

4. when you forgot password mariadb or mysql, you should reset.

   • Step 1 stop service your mysql

         sudo systemctl stop mysql
     

     or

         sudo service mysql stop
     

     or in ubutnu & debian

         sudo /etc/init.d/mysql stop
     

     or for other distribution versions on CentOS, Fendora and RHEL

         sudo /etc/init.d/mysqld stop
     

   • Step 2

     start mysql in safe mode

     sudo mysqld_safe --skip-grant-tables &
     

   • Step 3 Login into MYSQL using root

     mysql -u root;
     

   • Step 4 Select the MYSQL database to use

     use mysql
     

   • Step 5

     Reset or change the password user root

     5.1 MYSQL version < 5.7

     update user set password=PASSWORD("newpassword") where user='root';
     

     5.2 MYSQL 5.7 or other than , mysql.user table "password" field -> "authentication_string"

     update user set authentication_string=password("newpassword") where user='root'; 
     

   • Step 6

     Flush the privileges, this function for reread without restarting mysql server

     flush privileges;
     

   • Step 7 Quit to mysql

     quit
     

   • Step 8 Stop and start the server again

     8.1 For Ubuntu & Debian

     sudo /etc/init.d/mysql stop
     sudo /etc/init.d/mysql start
     

     8.2 For CentOS, Fendora, and RHEL

     sudo /etc/init.d/mysqld stop
     sudo /etc/init.d/mysqld start
     

   • Step 9 Login With a new password

     mysql -u root -p
     

   • Step 10 Type the new password and enjoy your server again like nothing happend

5. if you want to create another user for access mariadb

   • Step 1

     Login to Mysql using root

     mariadb -u root -p
     

     make sure your typing correct password

   • Step 2 create new user

     GRANT ALL ON *.* TO 'newuser'@'host/localhost' IDENTIFIED BY 'yourpassword' WITH GRANT OPTION;
     

   • Step 3 flush privileges for recheck all without restarting mysql server

     flush privileges
     

   • Step 4

     quit
     

   • Step 5 When installed from the default repositories, MariaDB will start running automatically. To test this, check its status.

       ```
       sudo systemctl status mariadb
       ```
     

     then , You’ll receive output that is similar to the following: ```

       Output :
     
       ● mariadb.service - MariaDB 10.3.22 database server
       Loaded: loaded (/lib/systemd/system/mariadb.service; enabled; vendor preset: enabled)
       Active: active (running) since Tue 2020-05-12 13:38:18 UTC; 3min 55s ago
       Docs: man:mysqld(8)
               https://mariadb.com/kb/en/library/systemd/
       Main PID: 25914 (mysqld)
           Status: "Taking your SQL requests now..."
           Tasks: 31 (limit: 2345)
           Memory: 65.6M
           CGroup: /system.slice/mariadb.service
                   └─25914 /usr/sbin/mysqld
           ```
     

     If MariaDB isn’t running, you can start it with the command

     sudo systemctl start mariadb.
     

   
   * Step 6

   For an additional check, you can try connecting to the database using the mysqladmin tool, which is a client that lets you run administrative commands. For example, this command says to connect to MariaDB as root using the Unix socket and return the version:

    ```
    sudo mysqladmin version
    ```
   
    you will receive output similiar to this
   
    ```
    Output
    mysqladmin  Ver 9.1 Distrib 10.3.22-MariaDB, for debian-linux-gnu on x86_64
    Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
   
    Server version		10.3.22-MariaDB-1ubuntu1
    Protocol version	10
    Connection		Localhost via UNIX socket
    UNIX socket		/var/run/mysqld/mysqld.sock
    Uptime:			4 min 49 sec
   
    Threads: 7  Questions: 467  Slow queries: 0  Opens: 177  Flush tables: 1  Open tables: 31  Queries per second avg: 1.615
    ```
   

   • Step 7

     if you configured a separated administrative user with password authentication , you could perform the same opration by typing

     mysqladmin -u admin -p version
     

6. MySQL (MariaDB) Not Starting [closed]

   • ERROR if you see error this warning

     Job for mariadb.service failed because the control process exited with error code.
     See "systemctl status mariadb.service" and "journalctl -xe" for details.
     

   • Solving

     cd /var/lib/mysql
     ls
     rm -r *
     mysql_install_db --user=mysql --basedir=/usr --datadir=/var/lib/mysql
     

     then by adding correct package list and signature

     sudo apt-get install software-properties-common
     sudo apt-key adv --recv-keys --keyserver hkp://keyserver.ubuntu.com:80 0xF1656F24C74CD1D8
     sudo add-apt-repository 'deb [arch=amd64,arm64,ppc64el] http://mariadb.mirrors.ovh.net/MariaDB/repo/10.3/ubuntu bionic main'
     sudo apt update
     sudo apt install mariadb-server
     

7. Solving the “Too many levels of symbolic links” Error Or Forbidden( 403 ) when access file in /var/www

   • solving straight to solving : when symlink use to /var/www ln -s dir_source /var/www it not open or access this dir_source in /var/www because permittion

     You Can fix this issue with change mode to user or root permition

     sudo chmod 755 -R /var/www/dir_source
     

     and then change owner to www-data because should www-data permition in /var/www

     sudo chown www-data:www-data /var/www/dir_source
     

8. When create Virtual Host in Nginx ( Virtual Block ) not working 127.0.0.1:8081 in /etc/hosts
   

   • error Most web developers have adopted the practice to test locally using, for example, port 8080 or anoter port. One might wonder we can also accomplish this with /etc/hosts. For example, can we add the following line to the hosts file:

     127.0.0.1:8081       yourdomain.example.com
     

   unfortunatelly it can't ,The hosts file only deals with hostnames , not ports.

   
   
   • Solving To make work it , we can use a reverse proxy. A reverse proxy is typically a webserver like nginx. thats takes client requests and directs them to the appropriate backend server, These Backend servers can run on a different host and, more interesting to use a different port.

   Let’s take a look at how to configure this with Nginx. We can easily install nginx from our package manager like yum or apt-get. Its default installation folder is /etc/nginx.

   To configure a reverse proxy for baeldung.com, we add the following in a file called /etc/nginx/conf.d/baeldung.conf:

       server {
           listen 80;
   
           server_name baeldung.com;
   
           location / {
               proxy_pass http://127.0.0.1:8080/;
           }
       }
   

   When we use this config in /etc/hosts together with:

   127.0.0.1 yourdomain.example.com

   in /etc/hosts, nginx will receive our requests for yourdomain.example.com and direct those to the webserver running on 127.0.0.1:8080.

9. When you want to swith php version in ubuntu

   * check your php version
   
       ```
           php -v
       ```
   
   * install php version you want.Example to version8.1
       ```
           $ sudo add-apt-repository -y ppa:ondrej/php
           $ sudo apt update
           $ sudo apt install php8.1
       ```
   
   * you can disabled old version php use
       ```
           sudo a2dismod your_old_php_version
       ```
   
   * you can enabled new version php use
       ```
           sudo a2enmod php5.6
       ```
   
   * Or you can swicth use:
       ```
           sudo update-alternatives --config php
       ```
   

10. when you want to copy pub ssh key in ubuntu * make sure you has install and setting pbcopy & pb paste to make your job easier.

        a. install x-clip 
            ```
                sudo apt-get install x-clip -y
            ```
    
        b. edit your BASH settings file using your favorite text editor, example using nano
            ```
                nano ~/.bashrc
            ```
        c. then create an alias for pbcopy and pbpaste
            ```
                alias pbcopy='xclip -selection clipboard'
                alias pbpaste='xclip -selection clipboard -o'
            ```
    
    * and finally you can copy your ssh public file.
        ```
            cat ~/.ssh/id_rsa.pub | pbcopy
        ```
    

11. if net::ERR_ABORTED 504 (Gateway Timeout) vite svelte

    ```
        node ./node_modules/esbuild/install.js
    ```
    

12. Solving error Composer detected issues in your platform: Your Composer dependencies require a PHP version ">= 8.1.0". laravel

    * Solving by :
    
    [Solving Source](https://stackoverflow.com/questions/72846653/your-composer-dependencies-require-a-php-version-8-1-0)
    
    * remove and reinstall composer/vendor
    ```
    composer update --dry-run --ignore-platform-reqs
    ```
    

13. use many ssh in same machine

    • Solution - Add another public key on the same machine and use that with 'personal' gitlab account (both on same machine).

      navigate to .ssh folder in your profile (even works on windows) and run command

          ssh-keygen -t rsa
      

      when asked for file name give another filename id_rsa_2 (or any other). enter for no passphrase (or otherwise). You will end up making id_rsa_2 and id_rsa_2.pub

      use the command

      cat id_rsa_2.pub
      

      copy and save key in 'personal' Gitlab account.

      create a file with no extension in .ssh folder named 'config'

      put this block of configuration in your config file

          Host           gitlab.com
          HostName       gitlab.com
          IdentityFile   C:\Users\<user name>\.ssh\id_rsa
          User           <user name>
      
      
          Host           gitlab_2
          HostName       gitlab.com
          IdentityFile   C:\Users\<user name>\.ssh\id_rsa_2
          User           <user name>
      

      now whenever you want to use 'personal' gitlab account simply change alias in git URLs for action to remote servers.

      for example instead of using

      `git clone [email protected]:..............
      

      simply use

          git clone git@gitlab_2:...............
      

      doing that would use the second configuration with gitlab.com (from 'config' file) and will use the new id_rsa_2 key pair for authentication.

      Find more about above commands on this link go to link

      source

14. Install PHP and enable JIT for

    • install PHP and Extension

    apt-get install nginx php php-fpm php-cli php-opcache php-mysql php-zip php-gd php-mbstring php-curl php-xml -y
    

    • enable opcache in php.ini open php.ini

    nano /etc/php/7.4/fpm/php.ini
    

    or

    nano /etc/php/8.1/fpm/php.ini
    

    The folder path may be different depending on the php version installed.

    • uncomment the following lines

    opcache.enable=1
    opcache.memory_consumption=128
    opcache.max_accelerated_files=10000
    opcache.revalidate_freq=200
    

    • and then you should be restart apache or nginx,

    systemctl restart nginx php7.4-fpm
    

    or if use apache

    systemctl restart apache2
    

    • You can now verify the PHP OPcache installation with the following command:

    php -i | grep opcache
    

    and you should get the following outpu:

    /etc/php/7.4/cli/conf.d/10-opcache.ini,
    opcache.blacklist_filename => no value => no value
    opcache.consistency_checks => 0 => 0
    opcache.dups_fix => Off => Off
    opcache.enable => On => On
    opcache.enable_cli => Off => Off
    opcache.enable_file_override => Off => Off
    opcache.error_log => no value => no value
    opcache.file_cache => no value => no value
    opcache.file_cache_consistency_checks => 1 => 1
    opcache.file_cache_only => 0 => 0
    opcache.file_update_protection => 2 => 2
    opcache.force_restart_timeout => 180 => 180
    

15. check all php in folder or subfolder

    find . -iname '*.php' -exec php -l '{}' \; | grep '^No syntax errors' -v  | less
    

16. Certbot Certificate

• Create Virtual host in to /etc/sites-available/domain.conf
• Binding to sites-enabled

sudo ln -s /etc/nginx/sites-available/domain.conf /etc/nginx/sites-enabled/
sudo nginx -t 
sudo systemctl restart nginx

• Install Certbot Package

sudo apt update
sudo apt install certbot
sudo apt install python3-certbot-apache
sudo certbot --nginx -d domain.com
sudo certbot renew --dry-run

18. Error acpu extension in mac If there error Root composer.json requires PHP extension ext-apcu * but it is missing from your system. Install or enable PHP's apcu extension.

Solving :

1. Install Extension apcu in Herd

pecl install apcu

NOTES : if there error pcre2.h: No such file or directory Solving :

brew install pcre2
ln -s /opt/homebrew/opt/pcre2/include/pcre2.h /opt/homebrew/opt/[email protected]/include/php/ext/pcre/

Beware of the PHP version in the destination, adjust as-needed. Then, re-run the installation that failed, e.g. apcu or openswoole. try again to install apcu

Youtube Downloader With Commands for Member Only

NOTES :

Reference :

1. https://daveparrish.net/posts/2018-06-22-How-to-download-private-YouTube-videos-with-youtube-dl.html
2. https://stackoverflow.com/questions/32104702/youtube-dl-library-and-error-403-forbidden-when-using-generated-direct-link-by
3. https://www.youtube.com/watch?v=Ghe058HpmMk

INSTALLATION

1. Install youtube-dl

https://snapcraft.io/youtube-dl

2. install extension EditThisCookie in Google Chrome
3. Open EditThisCookie -> options -> change choose the prefered export to [Netscape HTTP Cookie File]
4. Open and play yutube that will be downloaded, make sure you are logged in as a member.
5. Open EditThisCookie -> export -> Copy to clipboard
6. Open texteditor -> paste to text editor -> save with cookie_ty.txt
7. parsing cookie file

       curl -b cookie_ty.txt --cookie-jar yd.txt 'https://youtube.com'

8. youtube-dl --cookies=yd.txt [https://youtu.be/Q-xxxx-xxxx] //yutube that will be downloaded

PROBLEM AND FIXING

1. Problem Fix for youtube-dl Unable to extract uploader id

Solving : comment in line 1794 and save again run outube-dl --cookies=yd.txt [https://youtu.be/Q-xxxx-xxxx] -v open file extractor/youtube.py

   # 'uploader_id': self._search_regex(r'/(?:channel|user)/([^/?&#]+)', owner_profile_url, 'uploader id') if owner_profile_url else None,

see : https://www.youtube.com/watch?v=Ghe058HpmMk

2. Youtube-dl library and ERROR 403: Forbidden when using generated direct link by youtube-dl from different locations

Solving : Remove cache

youtube-dl --rm-cache-dir