NotionNext BLOG https://tangly1024.com/ 这是一个由NotionNext生成的站点 Tue, 18 Jun 2024 14:12:07 GMT https://validator.w3.org/feed/docs/rss2.html https://github.com/jpmonette/feed zh-CN All rights reserved 2024, NotionNext <![CDATA[11-ELB]]> https://tangly1024.com/article/27782e54-4b85-4028-9aaa-2c2f2d1ed332 https://tangly1024.com/article/27782e54-4b85-4028-9aaa-2c2f2d1ed332 Thu, 04 Apr 2024 00:00:00 GMT
  1. ELB
    1. Elastic Load Balancer
]]> <![CDATA[10-Route 53]]> https://tangly1024.com/article/4be7fccc-f193-4438-bc57-41fe3ddfc5bd https://tangly1024.com/article/4be7fccc-f193-4438-bc57-41fe3ddfc5bd Thu, 04 Apr 2024 00:00:00 GMT
  1. DNS: domain name system
    1. dns operates on 53
    2. named after route 66
  1. IPv4 32 bit field - 4 billion different addresses
  1. IPv6 128 bits
  1. top level domain
    1. google.com / .com
    2. be controlled by the internet assigned numbers authority - IANA
  1. domain registrars
  1. Record type
    1. SOA
    2. NS
      1. target to name server
    3. A
      1. address
      2. translate to ip address
    4. CNAME
      1. canonical name
      2. to domain
    5. alias records
      1. within aws service
  1. TTL: time to live
  1. policy
    1. weighted routing policy
      1. control in percent
    2. fallover routing policy
    3. geolocation routing policy
    4. geoproximity routing policy
      1. traffic flow only
    5. latency routing policy
    6. multivalue answer routing
  1. choose alias record over cname 👀
 
]]> <![CDATA[09-VPC]]> https://tangly1024.com/article/e3f3dfed-6d7e-4ff6-a989-76c937ce2d2d https://tangly1024.com/article/e3f3dfed-6d7e-4ff6-a989-76c937ce2d2d Thu, 04 Apr 2024 00:00:00 GMT
  1. VPC: Virtual Private Cloud
    1. virtual data center
  1. network diagram
notion image
  1. one subnet only exit in one availiablity zone
  1. cidr: Classless Inter-Domain Routing
  1. range
    1. /16 to /28
    2. 192.168.0.0/24 host/subnet
  1. build a self VPC
    1. add vpc
    2. add subnet
    3. add internet gateway
      1. attach to vpc
    4. add route tables
      1. add to internet gateway
      2. add public sublnet to explicit subnet associations
  1. NAT
    1. Network Address Translation Gateway
    2. safely request the outside without export port
  1. security groups
    1. Responses to allowed inbound traffic are allowed to flow out, regardless of outbound rules.
    2. stateful
  1. network acls
    1. a subnet can be associated with only 1 network acl at a time
    2. stateless
    3. default will allows all traffic
    4. custom network acls denies all traffic
    5. use acls to block ips
    6. rules started at lowest number rule
  1. vpc endpoints
    1. like nat gateways
    2. communicate with internal gateways
    3. virtual divices
    4. types
      1. interface endpoints
        1. private ip address
      2. gateway endpoints
        1. similar to NAT
    5. can use gateway endpoints to connect to s3 from ec2
  1. vpc peering
    1. allow connect 1 vpc with another route using private ip
  1. private link
    1. peering vpcs to 10 100 or 1000 of customer vpcs, use this
    2. requires a network load balancer on the service vpc and an eni on the custmer vpc
  1. vpc cloudhub
    1. aggregate from all your different customer sites all over the world
  1. direct connect
    1. establish a dedicated network connection from your premises to AWS
    2. types
      1. dedicated connection
      2. hosted connection
        1. from partner
    3. direct connect to aws
    4. useful for high-throughput workloads
    5. helpful when you need a stable and reliable secure connection
  1. transit gateway
    1. can simplify your network topology
    2. not support vpc peering connection configuration
  1. 5g networking with aws wavelength
]]> <![CDATA[08-RDS]]> https://tangly1024.com/article/615ea3f0-895a-4a4a-b333-437cfebe624d https://tangly1024.com/article/615ea3f0-895a-4a4a-b333-437cfebe624d Thu, 04 Apr 2024 00:00:00 GMT
  1. RDS: Relational Database System
  1. types
    1. sql server
    2. mysql
    3. oracle
    4. postgreSQl
    5. mariaDB
    6. aurora
  1. feature
    1. multi-AZ
    2. failover capability
    3. automated backups
  1. OLTP: used for online transaction processing
    1. RDS
  1. diff between OLAP：
    1. OLAP: online analytical processing
      1. take a long time to complete
      2. like redshift
  1. performance
    1. increate read performance
      1. read replicas
        1. read only copy
        2. not for disaster recovery
  1. Aurora
    1. relational DB
    2. 5 times better performance than MySQL and 3 time better than PostgreSQL
    3. 10GB start & 10G increments to 128T
    4. scale up to 96vcpus and 768 GB of memory
    5. 2 copy of data in each availability zone
    6. minimum of 3 availability zones
    7. at least 6 copies of data
  1. dynamoDB
    1. non-relational DB
    2. store on SSD
    3. spread across 3 geo distinct data centers
    4. eventually consistent reads(default)
    5. strongly consistent reads
    6. accelerator - DAX
      1. in memory cache
      2. 10x perf improvement
    7. transaction
      1. atomicity, consistency, isolation and durability - ACID
    8. backups
      1. point in time recovery is not enabled by default
  1. DocumentDB
    1. is a way to run mangoDB
  1. Apache Cassandra workloads with amazon keyspaces
    1. Cassandra
      1. distributed db
      2. nosql
      3. big data solutions
    2. keyspaces
      1. cassandra db service
  1. Amazon Neptune
    1. graph db
  1. Amazon Quantum Ledger DB
    1. QLDB
    2. immutable
    3. crypto currencies
  1. Amazon Timestream
    1. time-series data
]]> <![CDATA[07-EBS/EFS]]> https://tangly1024.com/article/b4e13144-5143-45e6-b46b-10b7c4cb4700 https://tangly1024.com/article/b4e13144-5143-45e6-b46b-10b7c4cb4700 Thu, 04 Apr 2024 00:00:00 GMT
  1. EBS
    1. Elastic Block Store
    2. storage volumes with ec2
    3. virtual hard disk
    4. types
      1. general purpose ssd - gp2
        1. 3 IOPS per GiB, up to 16000 IOPS per volume
      2. general purpose ssd - gp3
        1. 3000 IOPS, 125 MiB/s regardless of volume size
        2. can scale up to 16000 IOPS
      3. provisioned IOPS SSD - io1
        1. up to 64000 IOPS per volumn. 50 IOPS per GiB
        2. high performance / mose expensive
      4. provisioned IOPS SSD - io2
        1. latest
        2. higher durability and more IOPS
        3. the same price as io1
        4. up to 64000 IOPS per volumn. 500 IOPS per GiB
        notion image
      5. Throughput Optimized HDD - st1
        1. hardware
        2. low-cost
        3. 40 MB/s per TB, up to 250 MB/s per TB
        4. max 500 MB/s per volume
        5. cannot be a boot volume
      6. COLD HDD - sc1
        1. lowest cost option
        2. 12 MB/s per TB, up to 80 MB/s per TB
        3. max 250 MB/s per volume
        4. cannot be a boot volume
        notion image
    5. diff between IOPS and throughput
      1. IOPS: times
      2. Throughput: number of bits
  1. volumes
    1. volume exist on EBS
  1. snapshot
    1. exist on s3
    2. are incremental
    3. consistent snapshots: stop the instance and take a snap
    4. share only in the same region
    5. exist on the same AZ as EC2
    6. can resize on the fly
    7. can switch volume on the fly
  1. encrpte
    1. AES-256
  1. hibernation
    1. safe info from memory to disk
    2. do not need to reload the operating system
    3. RAM must be less than 150GB
  1. EFS
    1. Elastic File System
    2. content management
    3. use NFSv4 protocol
    4. 1000s Concurrent Connections
    5. 10 Gbps Throughput
    6. scaling Petabytes
    7. types
      1. Standard
      2. Infrequently Accessed
  1. FSx
    1. file system
    2. based on Windows server
  1. AMI: Amazon Machine Image
  1. EBS vs Instance Store
    1. Instance Store: ephemeral storage
    2. EBS can be stoped, IS cannot
  1. platform
    1. EFS: linux
    2. FSx: Windows
    3. FSx for Lustre:
      1. can store data on S3
      2. Linux
]]> <![CDATA[06-EC2]]> https://tangly1024.com/article/4edbd6b5-f48d-4e5e-86ea-794ea0a76ab2 https://tangly1024.com/article/4edbd6b5-f48d-4e5e-86ea-794ea0a76ab2 Thu, 04 Apr 2024 00:00:00 GMT

EC2

  1. Elastic Compute Cloud
  1. estimate capacity: for 3-5 years
  1. pricing options
    1. on demand
    2. reserved: for discount
    3. spot: purchase unused capacity
      1. feature
        1. stateless
        2. fault-tolerant
        3. flexible
      2. will be stoped while the price is above your limit
    4. dedicated: A physical ec2 server(most expensive)
      1. compliance
      2. licensing
  1. launch pools
    1. spot fleet: meet your capacity
  1. reserved instances
    1. standard: 买了不能改
    2. convertible：买了可以往上改
    3. scheduled：只买特定时间段
  1. AWS Command Line
    1. use in ec2
    2. such as
      1. aws s3 ls
    3. how to use it
      1. create ec2
      2. create iam users
      3. create user groups
      4. assign to target user groups & generate access key
    4. attach with role
      1. do things like aws configure
      2. more safer, because there is no password on the ec2
  1. security groups
    1. like virtual firewalls
  1. bootstrap scripts
    1. runs when the instance first runs
  1. metadata: info about ec2 instance
  1. userdata: simply bootstrap scripts
  1. networking
    1. ENI: Elastic Network Interface [default]
      1. day to day networking
    2. EN: Enhanced Networking [10g - 100g]
      1. single root IO virtualization — high performance
    3. EFA: Elastic Fabric Adapter
      1. accelerates high performance computing — high performance for ML
  1. placement groups
    1. cluster: in same availability zone
    2. spread: separate from each other
      1. such as db instance 1 & 2
      2. not on the same hardware
    3. partition: multiple ec2 instances
      1. different power sources
  1. vCenter
    1. VMWare
  1. aws outposts
    1. use aws servers on-premise(locally)
    2. outposts rack
      1. 42u - 96u
    3. outposts servers
      1. 1u - 2u
    4. process
      1. order
      2. install
      3. launch
      4. build
  1. exercies
    1. policy ⇒ role ⇒ instance profile ⇒ ec2
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
    ]]>