Sharing my personal journey, research, experiences and continuous learning across technology, NSE options trading, spirituality, world evolution and history.
Explore Blog → About MeRestarting my career from where I left off.
With hands-on experience as a Microsoft SQL Server DBA, I have developed skills in database management, performance monitoring, troubleshooting, and maintaining system stability.
Committed to continuous learning and professional development. Server DBA journey. With past experience and continuous learning, I am committed to growing my skills and building a stronger career in database administration.
Introduction to Big Data:
Introduction to Big Data: Transforming the Modern World
In today’s digital age, the amount of data generated every second is staggering. From social media interactions to online shopping transactions, from GPS navigation to IoT devices, data is being created at an unprecedented scale. This explosion of data has led to the emergence of a transformative field known as Big Data.
Big Data refers to extremely large and complex datasets that traditional data processing tools and techniques cannot handle efficiently. It encompasses structured, semi-structured, and unstructured data that grows rapidly in volume, variety, and velocity. These are often referred to as the 3 Vs of Big Data
Volume: The massive amount of data generated every second (e.g., terabytes to petabytes of data).
Velocity: The speed at which data is generated and processed (e.g., real-time analytics).
Variety: The diverse types of data (e.g., text, images, videos, and sensor data).
Importance of Big Data
Big Data is not just about the data itself but about the ability to analyze and derive actionable insights from it. Here’s why Big Data is essential:
Improved Decision-Making: Organizations can make data-driven decisions by analyzing historical and real-time data.
Enhanced Customer Experience: Personalizing services and recommendations based on customer behavior.
Operational Efficiency: Streamlining operations, predicting maintenance needs, and optimizing resources.
Big Data is transforming industries worldwide. Here are some notable applications:
Competitive Advantage: Gaining insights into market trends and staying ahead of competitors.
Healthcare:
Analyzing patient data for predictive diagnostics and personalized treatments.
Tracking disease outbreaks and improving public health responses.
Finance:
Detecting fraudulent transactions using real-time analytics.
Enhancing investment strategies with algorithmic trading and market analysis.
Retail:
Optimizing inventory and supply chains.
Delivering personalized recommendations to customers.
Transportation:
Managing traffic flow and reducing congestion with real-time data from GPS and sensors.
Optimizing logistics and fleet management.
Entertainment:
Recommending content on streaming platforms like Netflix based on viewing history.
Analyzing social media trends to create engaging content.
Agriculture:
Using data from sensors to monitor soil conditions, weather patterns, and crop health.
Optimizing water usage and maximizing yields with precision farming.
Government:
Enhancing public safety with predictive policing.
Improving urban planning with insights from smart city data.
I paid around INR150 for 1 KG of Tomato (current market price may differs other states of india or country )
What is the price of 1 KG Tomato in your area?
Check Availability Group Health:
SELECT
ag.name AS
[Availability Group],
ar.replica_server_name AS [Replica Server],
adc.database_name
AS [Database],
ags.is_local AS
[Is Local],
ags.is_primary_replica AS [Is Primary]
FROM
sys.availability_groups AS ag
INNER JOIN
sys.dm_hadr_availability_replica_states AS ars
ON ag.group_id
= ars.group_id
INNER JOIN
sys.dm_hadr_availability_replica_cluster_states AS arcs
ON
ars.group_id = arcs.group_id
AND
ars.replica_id = arcs.replica_id
INNER JOIN
sys.dm_hadr_database_replica_cluster_states AS adc
ON
arcs.group_id = adc.group_id
AND
arcs.replica_id = adc.replica_id
INNER JOIN
sys.availability_group_listeners AS agl
ON ag.group_id
= agl.group_id
INNER JOIN
sys.dm_hadr_availability_replica_states AS ags
ON
ags.replica_id = ars.replica_id
WHERE
ars.is_local = 1;
This script provides an overview of the availability group
health, including the availability group name, replica server name, database
name, and whether the replica is the primary replica or not.
Check Data Synchronization:
SELECT
ag.name AS
[Availability Group],
d.name AS
[Database],
drs.synchronization_state_desc AS [Synchronization State],
drs.synchronization_health_desc AS [Synchronization Health]
FROM
sys.availability_groups AS ag
INNER JOIN sys.dm_hadr_database_replica_states
AS drs
ON ag.group_id
= drs.group_id
INNER JOIN
sys.databases AS d
ON
drs.database_id = d.database_id;
This script shows the synchronization state and health of
the databases within the availability group. It provides information on whether
the data is synchronized or if there are any synchronization issues.
Check Availability Group Listener:
SELECT
ag.name AS
[Availability Group],
agl.dns_name AS
[Listener DNS Name],
agl.port AS
[Listener Port],
agl.state_desc AS
[Listener State]
FROM
sys.availability_groups AS ag
INNER JOIN
sys.availability_group_listeners AS agl
ON ag.group_id
= agl.group_id;
This script displays the availability group name, listener
DNS name, port, and the state of the availability group listener.
Check Failover Readiness:
SELECT
ag.name AS
[Availability Group],
drs.database_id AS
[Database ID],
d.name AS
[Database],
drs.is_failover_ready
AS [Is Failover Ready]
FROM
sys.availability_groups AS ag
INNER JOIN
sys.dm_hadr_database_replica_states AS drs
ON ag.group_id
= drs.group_id
INNER JOIN
sys.databases AS d
ON
drs.database_id = d.database_id;
SQL scripts that may be helpful for MS SQL Server DBAs in their daily tasks:
1.Script to Backup a Database:
BACKUP DATABASE [YourDatabaseName]
TO DISK = 'C:\Backup\YourDatabaseName.bak'
WITH INIT, FORMAT, COMPRESSION;
2.Script to Restore a Database:
RESTORE DATABASE [YourDatabaseName]
FROM DISK = 'C:\Backup\YourDatabaseName.bak'
WITH REPLACE, RECOVERY;
3.Script to Check Database Integrity:
DBCC CHECKDB ('YourDatabaseName') WITH NO_INFOMSGS;
Script to Shrink Transaction Log File:
DBCC SHRINKFILE ('YourDatabaseName_log', 1);
SELECT
r.session_id,
r.start_time,
r.status,
r.command,
t.text AS [SQL Text]
FROM
sys.dm_exec_requests r
CROSS APPLY
sys.dm_exec_sql_text(r.sql_handle) t
WHERE
r.status NOT IN
('background', 'sleeping')
ORDER BY
r.start_time DESC;
4..Script to Grant Permissions to a User:
USE [YourDatabaseName]
GO
GRANT SELECT, INSERT, UPDATE, DELETE ON [YourSchema].[YourTable]
TO [YourUserName];
5.Script to Update Statistics for a Table:
USE [YourDatabaseName]
GO
UPDATE STATISTICS [YourSchema].[YourTable];
CLOUD COMPUTING
Script to
Monitor Blocking Queries:
SELECT
r.session_id,
r.blocking_session_id,
t.text AS [SQL
Text]
FROM
sys.dm_exec_requests r
CROSS APPLY
sys.dm_exec_sql_text(r.sql_handle) t
WHERE
r.blocking_session_id <> 0;
Script to
Monitor Server Performance:
SELECT
[object_name],
[counter_name],
[cntr_value]
FROM
sys.dm_os_performance_counters
WHERE
[object_name] LIKE
'%:SQLServer%'
AND [counter_name]
IN ('Batch Requests/sec', 'Transactions/sec', 'User Connections')
ORDER BY
[object_name],
[counter_name];
Script to
Identify Index Fragmentation:
SELECT
dbschemas.[name] +
'.' + dbtables.[name] AS [Table Name],
dbindexes.[name]
AS [Index Name],
indexstats.avg_fragmentation_in_percent
FROM
sys.dm_db_index_physical_stats(DB_ID(), NULL, NULL, NULL, NULL) AS
indexstats
INNER JOIN
sys.tables dbtables ON dbtables.[object_id] = indexstats.[object_id]
INNER JOIN
sys.schemas dbschemas ON dbtables.[schema_id] = dbschemas.[schema_id]
INNER JOIN
sys.indexes AS dbindexes ON dbindexes.[object_id] = indexstats.[object_id] AND
indexstats.index_id = dbindexes.index_id
WHERE
indexstats.avg_fragmentation_in_percent > 10
ORDER BY
indexstats.avg_fragmentation_in_percent DESC;
Script to Find High CPU Queries:
SELECT TOP 10
total_worker_time/execution_count AS Avg_CPU_Time,
total_worker_time
AS Total_CPU_Time,
execution_count,
creation_time,
last_execution_time,
st.text AS [SQL
Text]
FROM
sys.dm_exec_query_stats
AS qs
CROSS APPLY
sys.dm_exec_sql_text(qs.[sql_handle]) AS st
ORDER BY
total_worker_time/execution_count DESC;
Script to
Check Database Size and Space Usage:
EXEC sp_MSforeachdb '
USE [?];
SELECT
DB_NAME() AS
[Database Name],
(size * 8) AS
[Size (KB)],
FILEGROUP_NAME(data_space_id) AS [Filegroup],
name AS
[Logical Name],
(size * 8 -
FILEPROPERTY(name, ''SpaceUsed'') * 8) AS [Unused Space (KB)]
FROM
sys.master_files
WHERE
type = 0;
';
On the other hand, engineers and developers working on the security side have experienced growth. Their services and products have been in more demand in the last couple of months as workspaces worldwide have become more dependent on technology. In the US alone, the demand for cybersecurity professionals has surged by 65% since April
Restarting my career from where I left off. With hands-on experience as a Microsoft SQL Server DBA, I have developed skills in database mana...
