Non-orthogonal multiple access (NOMA) networks play an important role in defense communication scenarios. Deep learning (DL)-based solutions are being considered as viable ways to solve the issues in fifth-generation (5G) and beyond 5G (B5G) wireless networks, since they can provide a more realistic solution in the real-world wireless environment. In this work, we consider the deep Q-Network (DQN) algorithm-based user pairing downlink (D/L) NOMA network. We have applied the convex optimization (CO) technique and optimized the sum rate of all the wireless users. First, the near-far (N-F) pairing and near-near and far-far (N-N and F-F) pairing strategies are investigated for the multiple numbers of users, and a closed-form (CF) expression of the achievable rate is derived. After that, the optimal power allocation (OPA) factors are derived using the CO technique. Through simulations, it has been demonstrated that the DQN algorithms perform much better than the deep reinforcement learning (DRL) and conventional orthogonal frequency-division multiple access (OFDMA) schemes. The sum-rate performance significantly increases with OPA factors. The simulation results are in close agreement with the analytical results.
ChettriLBeraR.A comprehensive survey on Internet of things (IoT) toward 5G wireless systems. IEEE Intern Things J2020; 7: 16–32.
2.
TiwariRDeshmukhS. Performance analysis of UABS assisted heterogeneous network for disaster management. In: Proceedings of the 2019 IEEE 5th international conference for convergence in technology (I2CT), Bombay, India, 29–31 March 2019, pp. 1–6. New York: IEEE.
KumarA.Design of self-quadruplexing antenna using substrate-integrated waveguide technique. Microw Opt Technol Lett2019; 61: 2687–2689.
5.
TiwariRDeshmukhS.Handover count based MAP estimation of velocity with prior distribution approximated via NGSIM data-set. IEEE Trans Intell Transp Syst. Epub ahead of print 1January2021. DOI: 10.1109/TITS.2020.3043888.
6.
KumarAAl-HasanMA.A coplanar-waveguide-fed planar integrated cavity backed slotted antenna array using TE33 mode. Int J RF Microw Comput Aid Eng2020; 30: e22344.
7.
TiwariRDeshmukhS.Prior information-based Bayesian MMSE estimation of velocity in HetNets. IEEE Wirel Commun Lett2019; 8: 81–84.
8.
ChaudharyBPShankarRMishraRK.A tutorial on cooperative non-orthogonal multiple access networks. J Defen Model Simul Appl Meth Technol. Epub ahead of print 7February2021. DOI: 10.1177/1548512920986627.
9.
BhardwajLMishraRKShankarR.Sum rate capacity of non-orthogonal multiple access scheme with optimal power allocation. J Defen Model Simul Appl Meth Technol. Epub ahead of print 7February2021. DOI: 10.1177/1548512920983531.
10.
MalladiRBeuriaMKShankarR, et al. Investigation of the fifth-generation non-orthogonal multiple access technique for defense applications using deep learning. J Defen Model Simul Appl Meth Technol. Epub ahead of print 18June2021. DOI: 10.1177/15485129211022857.
ZaidiSKHasanSFGuiX.Evaluating the ergodic rate in SWIPT-aided hybrid NOMA. IEEE Commun Lett2018; 22: 1870–1873.
14.
TangJLuoJLiuM, et al. Energy efficiency optimization for NOMA with SWIPT. IEEE J Select Top Signal Process2019; 13: 452–466.
15.
RuanTChewZJZhuM.Energy-aware approaches for energy harvesting powered wireless sensor nodes. IEEE Sens J2017; 17: 2165–2173.
16.
ZhaoMZhaoJZhouW, et al. Energy efficiency optimization in relay-assisted networks with energy harvesting relay constraints. Chin Commun2015; 12: 84–94.
17.
BeuriaMKShankarRSinghSS.Analysis of the energy harvesting non-orthogonal multiple access technique for defense applications over Rayleigh fading channel conditions. J Defen Model Simul Appl Meth Technol. Epub ahead of print 3July2021. DOI: 10.1177/15485129211021168.
18.
PandyaSKrishnaPShankarR, et al. Examination of the fifth-generation vehicular simultaneous wireless information and power transfer cooperative non-orthogonal multiple access network in military scenarios considering time-varying and imperfect channel state information conditions. J Defen Model Simul Appl Meth Technol. Epub ahead of print 10August2021. DOI: 10.1177/15485129211033040.
19.
KoHPackS.OB-DETA: observation-based directional energy transmission algorithm in energy harvesting networks. J Commun Netw2019; 21: 168–176.
20.
LiHLiJLiuM, et al. Energy harvesting and resource allocation for cache-enabled UAV based IoT NOMA networks. IEEE Trans Veh Technol2021; 70: 9625–9630.
21.
SinghCKSinghVUpadhyayPK, et al. Energy harvesting in overlay cognitive NOMA systems with hardware impairments. IEEE Syst J. Epub ahead of print 8June2021. DOI: 10.1109/JSYST.2021.3082552.
22.
WangHShiRTangK, et al. Performance analysis and optimization of a cooperative transmission protocol in NOMA-assisted cognitive radio networks with discrete energy harvesting. Entropy2021; 23: 785.
23.
SiddiquiAMMusavianLAïssaS.Time-switching energy harvesting communications: harvesting beneficialness and performance evaluation. IEEE Trans Veh Technol2021; 70: 11023–11027.
24.
NiZMotaniM. Optimization of time-switching energy harvesting receivers over multiple transmission blocks. In: Proceedings of the 2016 IEEE international symposium on information theory (ISIT), Barcelona, 10–15 July 2016, pp. 2749–2753. New York: IEEE.
25.
XuYGuiGGacaninH, et al. A survey on resource allocation for 5G heterogeneous networks: current research, future trends, and challenges. IEEE Commun Surv Tut2021; 23: 668–695.
26.
SharmaVSrinivasanKChaoHC, et al. Intelligent deployment of UAVs in 5G heterogeneous communication environment for improved coverage. J Netw Comput Appl2017; 85: 94–105.
27.
ShankarRMishraRK. Outage probability analysis of selective-decode and forward cooperative wireless network over time varying fading channels with node mobility and imperfect CSI condition. In: Proceedings of the TENCON 2018—2018 IEEE Region 10 conference, Jeju, South Korea, 28–31 October 2018, pp. 508–513. New York: IEEE.
28.
ShankarRPandeyKNKumariA, et al. C(0) protocol based cooperative wireless communication over Nakagami-m fading channels: PEP and SER analysis at optimal power. In: Proceedings of the 2017 IEEE 7th annual computing and communication workshop and conference (CCWC), Las Vegas, NV, 9–11 January 2017, pp. 1–7. New York: IEEE.
29.
ShankarRMishraRK.S-DF cooperative communication system over time selective fading channels. J Inform Sci Eng2019; 35: 1223–1248.
30.
ShankarRMishraRK.An investigation of S-DF cooperative communication protocol over keyhole fading channel. Phys Commun2018; 29: 120–140.
XuYShenCDingZ, et al. Joint beamforming and power-splitting control in downlink cooperative SWIPT NOMA systems. IEEE Trans Signal Process2017; 65: 4874–4886.
33.
YuanYXuYYangZ, et al. Energy efficiency optimization in full-duplex user-aided cooperative SWIPT NOMA systems. IEEE Trans Commun2019; 67: 5753–5767.
34.
YinSZhaoYLiL.UAV-assisted cooperative communications with time-sharing SWIPT. In: Proceedings of the 2018 IEEE international conference on communications (ICC), Kansas City, MO, 20–24 May 2018, pp. 1–6. New York: IEEE.
35.
VarshneyLR.Transporting information and energy simultaneously. In: Proceedings of the 2008 IEEE international symposium on information theory, Toronto, ON, Canada, 6–11 July 2008, pp. 1612–1616. New York: IEEE.
36.
ZhouXZhangRHoCK.Wireless information and power transfer: architecture design and rate-energy tradeoff. IEEE Trans Commun2013; 61: 4754–4767.
37.
LuoSXuJLimTJ, et al. Capacity region of MISO broadcast channel for simultaneous wireless information and power transfer. IEEE Trans Commun2015; 63: 3856–3868.
38.
HuangYClerckxB.Relaying strategies for wireless-powered MIMO relay networks. IEEE Trans Wirel Commun2016; 15: 6033–6047.
39.
LiXLiJLiL.Performance analysis of impaired SWIPT NOMA relaying networks over imperfect Weibull channels. IEEE Syst J2020; 14: 669–672.
40.
SunHZhouFHuRQ, et al. Robust beamforming design in a NOMA cognitive radio network relying on SWIPT. IEEE J Select Area Commun2019; 37: 142–155.
41.
DoTNda CostaDBDuongTQ, et al. Improving the performance of cell-edge users in MISO-NOMA systems using TAS and SWIPT-based cooperative transmissions. IEEE Trans Green Commun Netw2018; 2: 49–62.
42.
YangZDingZFanP, et al. The impact of power allocation on cooperative non-orthogonal multiple access networks with SWIPT. IEEE Trans Wirel Commun2017; 16: 4332–4343.
43.
DoNTda CostaDBDuongTQ, et al. A BNBF user selection scheme for NOMA-based cooperative relaying systems with SWIPT. IEEE Commun Lett2017; 21: 664–667.
44.
TangJDaiTCuiM, et al. Optimization for maximizing sum secrecy rate in SWIPT-enabled NOMA systems. IEEE Access2018; 6: 43440–43449.
45.
YeYLiYWangD, et al. Power splitting protocol design for the cooperative NOMA with SWIPT. In: Proceedings of the IEEE international conference on communications (ICC), Paris, 21–25 May 2017, pp. 1–5. New York: IEEE.
46.
LiuYDingZEïkashlanM, et al. Cooperative non-orthogonal multiple access in 5G systems with SWIPT. In: Proceedings of the 23rd European signal processing conference (EUSIPCO), Nice, 31 August–4 September 2015, pp. 1999–2003. New York: IEEE.
47.
ZhangLLiuJXiaoM, et al. Performance analysis and optimization in downlink NOMA systems with cooperative full-duplex relaying. IEEE J Select Area Commun2017; 35: 2398–2412.
48.
LuoJTangJSoDKC, et al. A deep learning-based approach to power minimization in multi-carrier NOMA with SWIPT. IEEE Access2019; 7: 17450–17460.
49.
DingZFanPPoorHV.Impact of user pairing on 5G nonorthogonal multiple-access downlink transmissions. IEEE Trans Veh Technol2016; 65: 6010–6023.
WuHLiXDengY.Deep learning-driven wireless communication for edge-cloud computing: opportunities and challenges. J Cloud Comput2020; 9: 21.
52.
LiMLiH.Application of deep neural network and deep reinforcement learning in wireless communication. PLoS ONE2020; 15: e0235447.
53.
DaiLJiaoRAdachiF, et al. Deep learning for wireless communications: an emerging interdisciplinary paradigm. IEEE Wirel Commun2020; 27: 133–139.
54.
LeeJSoJ.Reinforcement learning-based joint user pairing and power allocation in MIMO-NOMA systems. Sensors2020; 20: 7094.
55.
YangNZhangHLongK, et al. Deep neural network for resource management in NOMA networks. IEEE Trans Veh Technol2020; 69: 876–886.
56.
JiangFGuZSunC, et al. Dynamic user pairing and power allocation for NOMA with deep reinforcement learning. In: Proceedings of the 2021 IEEE wireless communications and networking conference (WCNC), Nanjing, China, 29 March–1 April 2021, pp. 1–6. New York: IEEE.
57.
ElsayedMAM. Deep reinforcement learning for efficient uplink NOMA SWIPT transmissions. Master’s Thesis, Qatar University, Doha, Qatar, 2021.
58.
ShankarR.Examination of a non-orthogonal multiple access scheme for next generation wireless networks. J Defen Model Simul Appl Meth Technol. Epub ahead of print 14September2020. DOI: 10.1177/1548512920951277.
59.
AldababsaMTokaMGökçeliS, et al. A tutorial on nonorthogonal multiple access for 5G and beyond. Wirel Commun Mob Comput2018; 2018: 9713450.
60.
TiwariRShrivastavaSDasS. Performance analysis of patient monitoring system under different routing algorithm. In: Proceedings of the international conference for convergence for technology, Pune, India, 6–8 April 2014, pp. 1–6. New York: IEEE.
61.
TiwariRDeshmukhS. Sojourn time based maximum likelihood estimator for velocity estimation in HetNets. In: Proceedings of the 23rd national conference on communications (NCC), Chennai, India, 2–4 March 2017, pp. 1–6. New York: IEEE.
62.
TiwariRDeshmukhS.ML based velocity estimator via gamma distributed handover counts in HetNets. In: Proceedings of the TENCON 2017—2017 IEEE Region 10 conference, Penang, Malaysia, 5–8 November 2017, pp. 1828–1833. New York: IEEE.
63.
TiwariRDeshmukhS.Analysis and design of an efficient handoff management strategy via velocity estimation in HetNets. Trans Emerg Telecommun Technol2019; 5: e3642.
64.
DivyaSVPaulSPatiUC.Structure tensor-based SIFT algorithm for SAR image registration. IET Imag Process2020; 14: 929–938.
65.
PaulSPatiUC.A comprehensive review on remote sensing image registration. Int J Rem Sens2021; 42: 5400–5436.
66.
PaulSDurgamUKPatiUC.Multimodal optical image registration using modified SIFT. In: Proceedings of the 4th international conference on advanced computing, networking, and informatics (ICACNI-2016), vol. 518, Rourkela, India, 22–24 September 2016, pp. 123–129. Singapore: Springer.
67.
PaulSPatiUC.SAR image registration using an improved anisotropic Gaussian-SIFT algorithm. In: Proceedings of the 14th IEEE India Council international conference (INDICON), Roorkee, India, 15–17 December 2017, pp. 1–5. New York: IEEE.
68.
PaulSPatiUC.Optical-to-SAR image registration using modified distinctive order based self-similarity operator. In: Proceedings of the IEEE international students’ conference on electrical, electronics and computer science (SCEECS), Bhopal, India, 24–25 February 2018, pp. 1–5. New York: IEEE.
69.
ZhuJWangJHuangY, et al. On optimal power allocation for downlink nonorthogonal multiple access systems. IEEE J Select Area Commun2017; 35: 2744–2757.
