Skip to content

AMBARI-26313: Change metrics names in grafana dashboards as per the GC used in JDK17 #140

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
sandeepk318 wants to merge 1 commit into
base: master
Choose a base branch
from
Open

AMBARI-26313: Change metrics names in grafana dashboards as per the GC used in JDK17 #140

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/ambari.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ jobs:
distribution: temurin
cache: maven
- name: Install Kerberos development libraries
run: sudo apt-get install -y libkrb5-dev
run: sudo apt-get update && sudo apt-get install -y libkrb5-dev
- name: Install Kerberos
run: pip3 install kerberos
- name: Build with Maven
Expand Down
8 changes: 4 additions & 4 deletions ambari-metrics-timelineservice/conf/unix/amshbase_metrics_whitelist
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,11 @@ jvm.Master.JvmMetrics.ThreadsTerminated
jvm.Master.JvmMetrics.ThreadsTimedWaiting
jvm.Master.JvmMetrics.ThreadsWaiting
jvm.RegionServer.JvmMetrics.GcCount
jvm.RegionServer.JvmMetrics.GcCountConcurrentMarkSweep
jvm.RegionServer.JvmMetrics.GcCountParNew
jvm.RegionServer.JvmMetrics.GcCountG1 Old Generation
jvm.RegionServer.JvmMetrics.GcCountG1 Young Generation
jvm.RegionServer.JvmMetrics.GcTimeMillis
jvm.RegionServer.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.RegionServer.JvmMetrics.GcTimeMillisParNew
jvm.RegionServer.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.RegionServer.JvmMetrics.GcTimeMillisG1 Young Generation
jvm.RegionServer.JvmMetrics.MemHeapCommittedM
jvm.RegionServer.JvmMetrics.MemHeapMaxM
jvm.RegionServer.JvmMetrics.MemHeapUsedM
Expand Down
24 changes: 12 additions & 12 deletions ambari-metrics-timelineservice/conf/unix/metrics_whitelist
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -202,12 +202,12 @@ io.IOMetrics.PercentileDecodingTime_30s99thPercentileLatency
ipc.client.org.apache.hadoop.ipc.DecayRpcScheduler.Caller(*).Priority
ipc.client.org.apache.hadoop.ipc.DecayRpcScheduler.Caller(*).Volume
jvm.JvmMetrics.GcCount
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcCountParNew
jvm.JvmMetrics.GcCountG1 Old Generation
jvm.JvmMetrics.GcCountG1 Young Generation
jvm.JvmMetrics.GcNumWarnThresholdExceeded
jvm.JvmMetrics.GcTimeMillis
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisParNew
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.JvmMetrics.GcTimeMillisG1 Young Generation
jvm.JvmMetrics.GcTotalExtraSleepTime
jvm.JvmMetrics.LogError
jvm.JvmMetrics.LogFatal
Expand All @@ -234,11 +234,11 @@ jvm.Master.JvmMetrics.ThreadsTerminated
jvm.Master.JvmMetrics.ThreadsTimedWaiting
jvm.Master.JvmMetrics.ThreadsWaiting
jvm.RegionServer.JvmMetrics.GcCount
jvm.RegionServer.JvmMetrics.GcCountConcurrentMarkSweep
jvm.RegionServer.JvmMetrics.GcCountParNew
jvm.RegionServer.JvmMetrics.GcCountG1 Old Generation
jvm.RegionServer.JvmMetrics.GcCountG1 Young Generation
jvm.RegionServer.JvmMetrics.GcTimeMillis
jvm.RegionServer.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.RegionServer.JvmMetrics.GcTimeMillisParNew
jvm.RegionServer.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.RegionServer.JvmMetrics.GcTimeMillisG1 Young Generation
jvm.RegionServer.JvmMetrics.MemHeapCommittedM
jvm.RegionServer.JvmMetrics.MemHeapMaxM
jvm.RegionServer.JvmMetrics.MemHeapUsedM
Expand All @@ -253,10 +253,10 @@ jvm.RegionServer.JvmMetrics.ThreadsTimedWaiting
jvm.RegionServer.JvmMetrics.ThreadsWaiting
jvm.daemon_thread_count
jvm.file_descriptor_usage
jvm.gc.ConcurrentMarkSweep.count
jvm.gc.ConcurrentMarkSweep.time
jvm.gc.ParNew.count
jvm.gc.ParNew.time
jvm.gc.G1 Old Generation.count
jvm.gc.G1 Old Generation.time
jvm.gc.G1 Young Generation.count
jvm.gc.G1 Young Generation.time
jvm.heap_usage
jvm.memory.heap.committed
jvm.memory.heap.max
Expand Down
8 changes: 4 additions & 4 deletions ambari-metrics-timelineservice/src/main/resources/metrics_def/AMBARI_SERVER.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,10 +5,10 @@ jvm.buffers.mapped.capacity
jvm.buffers.mapped.count
jvm.buffers.mapped.used
jvm.file.open.descriptor.ratio
jvm.gc.ConcurrentMarkSweep.count
jvm.gc.ConcurrentMarkSweep.time
jvm.gc.ParNew.count
jvm.gc.ParNew.time
jvm.gc.G1 Old Generation.count
jvm.gc.G1 Old Generation.time
jvm.gc.G1 Young Generation.count
jvm.gc.G1 Young Generation.time
jvm.memory.heap.committed
jvm.memory.heap.init
jvm.memory.heap.max
Expand Down
8 changes: 4 additions & 4 deletions ambari-metrics-timelineservice/src/main/resources/metrics_def/AMS-HBASE.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,10 @@ regionserver.WAL.SyncTime_min
regionserver.WAL.SyncTime_num_ops
regionserver.WAL.appendCount
regionserver.WAL.slowAppendCount
jvm.JvmMetrics.GcCountParNew
jvm.JvmMetrics.GcCountG1 Young Generation
jvm.JvmMetrics.GcTimeMillis
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisParNew
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.JvmMetrics.GcTimeMillisG1 Young Generation
ugi.UgiMetrics.GetGroupsAvgTime
ugi.UgiMetrics.GetGroupsNumOps
ugi.UgiMetrics.LoginFailureNumOps
Expand Down Expand Up @@ -197,7 +197,7 @@ regionserver.Server.checkMutateFailedCount
regionserver.Server.checkMutatePassedCount
regionserver.Server.compactionQueueLength
regionserver.Server.flushQueueLength
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcCountG1 Old Generation
regionserver.Server.hlogFileCount
regionserver.Server.hlogFileSize
regionserver.Server.memStoreSize
Expand Down
8 changes: 4 additions & 4 deletions ambari-metrics-timelineservice/src/main/resources/metrics_def/DATANODE.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -95,13 +95,13 @@ dfs.datanode.WriteBlockOpNumOps
dfs.datanode.WritesFromLocalClient
dfs.datanode.WritesFromRemoteClient
jvm.JvmMetrics.GcCount
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcCountParNew
jvm.JvmMetrics.GcCountG1 Old Generation
jvm.JvmMetrics.GcCountG1 Young Generation
jvm.JvmMetrics.GcNumInfoThresholdExceeded
jvm.JvmMetrics.GcNumWarnThresholdExceeded
jvm.JvmMetrics.GcTimeMillis
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisParNew
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.JvmMetrics.GcTimeMillisG1 Young Generation
jvm.JvmMetrics.GcTotalExtraSleepTime
jvm.JvmMetrics.LogError
jvm.JvmMetrics.LogFatal
Expand Down
8 changes: 4 additions & 4 deletions ambari-metrics-timelineservice/src/main/resources/metrics_def/HBASE_MASTER.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,11 +26,11 @@ ipc.IPC.queueSize
ipc.IPC.receivedBytes
ipc.IPC.sentBytes
jvm.Master.JvmMetrics.GcCount
jvm.Master.JvmMetrics.GcCountConcurrentMarkSweep
jvm.Master.JvmMetrics.GcCountParNew
jvm.Master.JvmMetrics.GcCountG1 Old Generation
jvm.Master.JvmMetrics.GcCountG1 Young Generation
jvm.Master.JvmMetrics.GcTimeMillis
jvm.Master.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.Master.JvmMetrics.GcTimeMillisParNew
jvm.Master.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.Master.JvmMetrics.GcTimeMillisG1 Young Generation
jvm.Master.JvmMetrics.LogError
jvm.Master.JvmMetrics.LogFatal
jvm.Master.JvmMetrics.LogInfo
Expand Down
8 changes: 4 additions & 4 deletions ambari-metrics-timelineservice/src/main/resources/metrics_def/HBASE_REGIONSERVER.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,11 +26,11 @@ ipc.IPC.queueSize
ipc.IPC.receivedBytes
ipc.IPC.sentBytes
jvm.RegionServer.JvmMetrics.GcCount
jvm.RegionServer.JvmMetrics.GcCountConcurrentMarkSweep
jvm.RegionServer.JvmMetrics.GcCountParNew
jvm.RegionServer.JvmMetrics.GcCountG1 Old Generation
jvm.RegionServer.JvmMetrics.GcCountG1 Young Generation
jvm.RegionServer.JvmMetrics.GcTimeMillis
jvm.RegionServer.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.RegionServer.JvmMetrics.GcTimeMillisParNew
jvm.RegionServer.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.RegionServer.JvmMetrics.GcTimeMillisG1 Young Generation
jvm.RegionServer.JvmMetrics.LogError
jvm.RegionServer.JvmMetrics.LogFatal
jvm.RegionServer.JvmMetrics.LogInfo
Expand Down
8 changes: 4 additions & 4 deletions ambari-metrics-timelineservice/src/main/resources/metrics_def/NAMENODE.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -267,13 +267,13 @@ dfs.namenode.TransactionsAvgTime
dfs.namenode.TransactionsBatchedInSync
dfs.namenode.TransactionsNumOps
jvm.JvmMetrics.GcCount
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcCountParNew
jvm.JvmMetrics.GcCountG1 Old Generation
jvm.JvmMetrics.GcCountG1 Young Generation
jvm.JvmMetrics.GcNumInfoThresholdExceeded
jvm.JvmMetrics.GcNumWarnThresholdExceeded
jvm.JvmMetrics.GcTimeMillis
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisParNew
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.JvmMetrics.GcTimeMillisG1 Young Generation
jvm.JvmMetrics.GcTotalExtraSleepTime
jvm.JvmMetrics.LogError
jvm.JvmMetrics.LogFatal
Expand Down
32 changes: 16 additions & 16 deletions ambari-metrics-timelineservice/src/test/resources/test_data/full_whitelist.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,8 +60,8 @@ regionserver.WAL.SyncTime_num_ops
regionserver.WAL.appendCount
regionserver.WAL.slowAppendCount
jvm.JvmMetrics.GcTimeMillis
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisParNew
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.JvmMetrics.GcTimeMillisG1 Young Generation
ugi.UgiMetrics.GetGroupsAvgTime
ugi.UgiMetrics.GetGroupsNumOps
ugi.UgiMetrics.LoginFailureNumOps
Expand Down Expand Up @@ -253,7 +253,7 @@ regionserver.Server.checkMutateFailedCount
regionserver.Server.checkMutatePassedCount
regionserver.Server.compactionQueueLength
regionserver.Server.flushQueueLength
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcCountG1 Old Generation
regionserver.Server.hlogFileCount
regionserver.Server.hlogFileSize
regionserver.Server.memStoreSize
Expand Down Expand Up @@ -284,7 +284,7 @@ regionserver.WAL.AppendSize_max
regionserver.WAL.AppendSize_mean
regionserver.WAL.AppendSize_median
regionserver.WAL.SyncTime_median
jvm.JvmMetrics.GcCountParNew
jvm.JvmMetrics.GcCountG1 Young Generation
regionserver.WAL.AppendSize_min
regionserver.WAL.AppendSize_num_ops
regionserver.WAL.SyncTime_max
Expand Down Expand Up @@ -322,8 +322,8 @@ regionserver.WAL.SyncTime_num_ops
regionserver.WAL.appendCount
regionserver.WAL.slowAppendCount
jvm.JvmMetrics.GcTimeMillis
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisParNew
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.JvmMetrics.GcTimeMillisG1 Young Generation
ugi.UgiMetrics.GetGroupsAvgTime
ugi.UgiMetrics.GetGroupsNumOps
ugi.UgiMetrics.LoginFailureNumOps
Expand Down Expand Up @@ -515,7 +515,7 @@ regionserver.Server.checkMutateFailedCount
regionserver.Server.checkMutatePassedCount
regionserver.Server.compactionQueueLength
regionserver.Server.flushQueueLength
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcCountG1 Old Generation
regionserver.Server.hlogFileCount
regionserver.Server.hlogFileSize
regionserver.Server.memStoreSize
Expand Down Expand Up @@ -546,7 +546,7 @@ regionserver.WAL.AppendSize_max
regionserver.WAL.AppendSize_mean
regionserver.WAL.AppendSize_median
regionserver.WAL.SyncTime_median
jvm.JvmMetrics.GcCountParNew
jvm.JvmMetrics.GcCountG1 Young Generation
regionserver.WAL.AppendSize_min
regionserver.WAL.AppendSize_num_ops
regionserver.WAL.SyncTime_max
Expand Down Expand Up @@ -585,7 +585,7 @@ regionserver.WAL.SyncTime_mean
regionserver.WAL.AppendSize_99th_percentile
jvm.JvmMetrics.GcTimeMillis
regionserver.WAL.AppendSize_75th_percentile
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
regionserver.WAL.SyncTime_max
regionserver.Server.Increment_median
regionserver.Server.updatesBlockedTime
Expand All @@ -595,7 +595,7 @@ regionserver.WAL.lowReplicaRollRequest
ugi.UgiMetrics.GetGroupsNumOps
regionserver.Server.storeFileSize
regionserver.Server.Increment_95th_percentile
jvm.JvmMetrics.GcTimeMillisParNew
jvm.JvmMetrics.GcTimeMillisG1 Young Generation
ugi.UgiMetrics.LoginFailureAvgTime
ugi.UgiMetrics.LoginFailureNumOps
regionserver.Server.storeFileCount
Expand Down Expand Up @@ -885,7 +885,7 @@ regionserver.Server.compactionQueueLength
regionserver.Server.flushedCellsSize
regionserver.Server.memStoreSize
regionserver.Server.mutationsWithoutWALSize
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcCountG1 Old Generation
regionserver.Server.regionServerStartTime
regionserver.Server.slowDeleteCount
regionserver.Server.slowIncrementCount
Expand All @@ -903,7 +903,7 @@ regionserver.Server.Replay_95th_percentile
regionserver.WAL.AppendTime_95th_percentile
regionserver.WAL.AppendTime_median
regionserver.WAL.AppendTime_max
jvm.JvmMetrics.GcCountParNew
jvm.JvmMetrics.GcCountG1 Young Generation
regionserver.WAL.AppendTime_mean
FSDatasetState.org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.CacheCapacity
FSDatasetState.org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.CacheUsed
Expand Down Expand Up @@ -1100,13 +1100,13 @@ dfs.namenode.TransactionsAvgTime
dfs.namenode.TransactionsBatchedInSync
dfs.namenode.TransactionsNumOps
jvm.JvmMetrics.GcCount
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcCountParNew
jvm.JvmMetrics.GcCountG1 Old Generation
jvm.JvmMetrics.GcCountG1 Young Generation
jvm.JvmMetrics.GcNumInfoThresholdExceeded
jvm.JvmMetrics.GcNumWarnThresholdExceeded
jvm.JvmMetrics.GcTimeMillis
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisParNew
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.JvmMetrics.GcTimeMillisG1 Young Generation
jvm.JvmMetrics.GcTotalExtraSleepTime
jvm.JvmMetrics.LogError
jvm.JvmMetrics.LogFatal
Expand Down
4 changes: 2 additions & 2 deletions ambari-metrics-timelineservice/src/test/resources/ui_metrics_def/NAMENODE.dat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,8 +21,8 @@ dfs.FSNamesystem.UnderReplicatedBlocks
||
rpc.rpc.NumOpenConnections
rpc.rpc.RpcQueueTimeAvgTime
jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep
jvm.JvmMetrics.GcCountConcurrentMarkSweep
jvm.JvmMetrics.GcTimeMillisG1 Old Generation
jvm.JvmMetrics.GcCountG1 Old Generation
jvm.JvmMetrics.MemHeapCommittedM
rpc.rpc.RpcProcessingTimeAvgTime
jvm.JvmMetrics.MemHeapUsedM
Expand Down
1 change: 1 addition & 0 deletions pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -183,6 +183,7 @@
--add-opens java.base/java.util.regex=ALL-UNNAMED
--add-opens java.base/java.util.concurrent=ALL-UNNAMED
--add-opens java.base/java.net=ALL-UNNAMED
--add-opens java.base/jdk.internal.reflect=ALL-UNNAMED
</argLine>

<!-- Each profile in the top-level pom.xml defines which test group categories to run. -->
Expand Down